Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................................X.........] duration:
452.487417ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:38:13 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 452.515537ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................................X........] duration:
450.978141ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:37:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 451.010725ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................................X.......] duration:
414.371144ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:36:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 414.428137ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................................................X......] duration:
491.69629ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:35:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 491.721829ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................................................X.....] duration:
955.026166ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:35:37 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 955.170477ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................................................X....] duration:
501.69227ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:34:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 501.724267ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
680.957608ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:34:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 681.013407ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
461.936485ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:33:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 461.961633ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
703.106904ms trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:33:15 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 703.274251ms
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.001337953s trace:
https://jaeger.dev.storj.io/trace/7fd64ef1f1f49b1f
FAIL (2026-03-21 08:32:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001362815s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
2.124004133s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:28:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.124051465s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.074731037s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:28:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.074762085s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.143926686s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:27:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.143956963s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
2.546121333s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:26:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.546149911s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
2.090523183s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:26:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.090558881s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
2.19760375s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:25:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.197638139s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
2.644607978s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:24:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.644638128s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
2.187903454s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:23:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.18806471s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
2.574134007s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:23:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.574162922s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
2.554889472s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:22:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.55492364s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.435484205s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:21:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.435516435s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.489857974s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:21:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.489880069s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.121071458s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:20:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.12110708s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.071286499s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:19:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.071340308s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.146588082s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:18:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.146615391s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.14840538s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:17:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.148435424s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.161852549s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:16:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.161880882s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.115634993s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:16:27 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.115665122s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.154234257s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:15:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.154357163s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.079310194s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:14:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.079343793s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.145864584s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:13:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.145924578s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.567515432s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:12:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.567546937s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.140877902s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:12:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.140916272s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.085623056s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:11:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.08567212s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.110088867s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:11:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.110121685s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.269857016s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:10:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.269898216s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.073813205s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:09:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.073846445s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.090368868s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:08:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.090513531s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
2.109634076s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:07:42 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.109660524s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.17050322s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:07:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.170541248s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.152319226s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:06:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.152432266s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.117861714s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:06:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.117894185s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.165805593s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:05:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.169914499s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.140609822s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:04:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.140643853s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.161451926s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:03:04 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.161500782s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.116305469s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:01:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.116341905s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
2.20298353s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:01:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.203090854s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
2.457913819s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:01:15 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.457941718s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
2.171461791s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 13:00:18 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.171500302s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.466120303s trace:
https://jaeger.dev.storj.io/trace/2222d6571ea8976c
FAIL (2026-03-19 12:59:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
uplink: eestream: quiescence
======LOGS======
upload=351443]: Uploading piece...
Mar 19 12:44:46.183845999 (313h44m43.780617039s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.184356763 (313h44m43.781127796s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185256915 (313h44m43.782027945s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.185883777 (313h44m43.78265481s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186238591 (313h44m43.783009619s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.186742838 (313h44m43.783513864s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187155550 (313h44m43.783926583s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.187624706 (313h44m43.784395736s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188327228 (313h44m43.785098255s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.188862169 (313h44m43.785633195s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Uploading piece...
Mar 19 12:44:46.623778767 (313h44m44.220549781s) [upload=351443]: Next returned nil segment
Mar 19 12:44:46.623796067 (313h44m44.22056708s) [upload=351443]: Waiting for error group managing segments...
Mar 19 12:44:46.785648057 (313h44m44.382419086s) [noise=true , address=81.171.14.70:4046 , piece_id=DX3Y4KK7HR3ZFQ4KA73GFCJGKGRTNWZ7M2U3NGQCSTDWJ33S2Y4A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.796504909 (313h44m44.393275931s) [noise=true , address=89.149.201.147:4015 , piece_id=AAZUNZTFBOHQFZBNTFSFZP7JPA3PG4L3DJOSTVTTYX5INT7FGYDQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805536962 (313h44m44.402307986s) [noise=true , address=81.171.14.70:4042 , piece_id=T4M6K6FJ77FBTC2U5XWZQXFFBLQRABFTU57JAGIHUGYNKQ2LLP2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.805767779 (313h44m44.402538808s) [noise=true , address=81.171.14.70:4034 , piece_id=HKPKL4LS4OLSTJSMBT2JEMJWBI4JZXVLUBUHLEW4CBMQ6OC4XKSQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806182192 (313h44m44.402953215s) [noise=true , address=81.171.14.70:4025 , piece_id=5QOCG7KCPIXW7HJOLCQ66M6OJTCV3RRZK6TME2QNT3LKHVBQTMIA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.806683347 (313h44m44.403454374s) [noise=true , address=89.149.201.147:4013 , piece_id=JTRTRW67JHOAJ7OWAIFGN5CR6NULSWKOEIR6KBTWQKA33XPI26XA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.807094747 (313h44m44.403865773s) [noise=true , address=185.167.204.206:4072 , piece_id=CYHKV6MBE4PBC4IGSE76FTB56GVRRFMWVLWWCEHV274YHSDVAZ2A, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809730091 (313h44m44.406501113s) [noise=true , address=81.171.14.70:4041 , piece_id=IIZEY2PRADL6THKPQ7M44P2K6TQWX7ZGZRJYT7W5ZVBXTPDTJ3ZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.809981995 (313h44m44.406753034s) [noise=true , address=81.171.14.70:4036 , piece_id=RJBOL3WGRLJL64BJSNWULIK4Y7G5LNMZMEPMPPMX6ICEQUDPMOHQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.818962014 (313h44m44.415733045s) [noise=true , address=81.171.14.70:4032 , piece_id=VC3UFBXHZQLQQF2EETNLVSQNJPXIXQKNJB55LKEDHUSUNIZ6ERJQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.823923202 (313h44m44.420694227s) [noise=true , address=89.149.201.147:4002 , piece_id=4B5EC4DQHITKHYOTQKTHHHTTMKE3WGWUUZQIBCHDMMGWAAJ5ZHDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.828331517 (313h44m44.425102546s) [noise=true , address=89.149.201.147:4012 , piece_id=ZVJRT2YDF3AL6HDBYBUSLOTU2THUHL46J5YATBGBF6RUDZYH47OA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.834639574 (313h44m44.431410599s) [noise=true , address=89.149.201.147:4009 , piece_id=IRJU5E23TKUCAPG3KE6DQG7KBXYFYGHVQZ5EDT5ROC2JRA4ONA6Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.837005340 (313h44m44.433776363s) [noise=true , address=89.149.201.147:4010 , piece_id=YK5WOQXWB227NFKNXT2DSKEFUQQTILFLAQGTIYZFUVONMEK3XHTQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.838706937 (313h44m44.435477962s) [noise=true , address=185.167.204.206:4037 , piece_id=WTTD3K3EI2KROO2NGDT5XKG7DW4PBOHLOEFPKZLRCTXM36QP5W2Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.850961182 (313h44m44.447732206s) [noise=true , address=89.149.201.147:4019 , piece_id=OQQ2BAY6F24HK3FM5MYYSWSRA4FMXK7542GGW7C244GJXROJG6LQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851222385 (313h44m44.447993408s) [noise=true , address=185.167.204.205:4016 , piece_id=AZIWUD7GBXD4CBFH4OSVSHX6Q55AOG2TC3LRNLBJGECSASGL6GEQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.851727308 (313h44m44.448498333s) [noise=true , address=185.167.204.205:4022 , piece_id=44OBHEBXV2XIVLSE3VEJJ4SDIBF3F6PDJD4CW4DQML2E2GMMS4BQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.862863006 (313h44m44.45963403s) [noise=true , address=185.167.204.205:4036 , piece_id=SHXQJUJZRZ4COS5XZUKWHVK7KN7732FKFVDPLGRWMFOI4NJZ5BGQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.870222435 (313h44m44.466993459s) [noise=true , address=89.149.201.147:4001 , piece_id=4KD7OETYMXUAIMPMJYKQ4PCMFTONALWTJODNVFCMFJCFZUXMEKMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.874341796 (313h44m44.47111282s) [noise=true , address=185.167.204.205:4009 , piece_id=KHMDGN7RQD7I45OYS56V4P6DYXD2QN6VHBCB4KT2LEHC2OCLJ5UA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.878234288 (313h44m44.475005311s) [noise=true , address=185.167.204.206:4041 , piece_id=ERP6LF5XJGRPJ3XMWZTRVM3BG4KGJEABMAULXBS42S7Y4THO3JRA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.888008455 (313h44m44.484779468s) [noise=true , address=185.167.204.205:4005 , piece_id=KGW5XSYRHN7QR3ROEZQLVFT6U7FKGNRW4SQISCES3XJ63SFWNVNQ, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.893970438 (313h44m44.490741464s) [noise=true , address=185.167.204.206:4039 , piece_id=I6FRPUBAVCWZ4MADZMWJO5INXCHIS474GFSUQJEOCXTF7CGX5Z3Q, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.894368808 (313h44m44.491139831s) [noise=true , address=185.167.204.206:4055 , piece_id=3BW36XNECPKFHAA2SE2UVNNZZBAUZZAQNDAAHMK6UQ5ALZWHLQMA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896022719 (313h44m44.492793732s) [noise=true , address=185.167.204.206:4059 , piece_id=ML4DP33NTS4W2G4SJE2ZALZQUF2GCTUR5NREPLLKUYAJRHIXUYZA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: <nil>
Mar 19 12:44:46.896057928 (313h44m44.492828944s) [seg_pos={0 0}, upload=351443]: Satisfied cohort requirements after 26 pieces
Mar 19 12:44:46.896391898 (313h44m44.493162928s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12oTu1GaRsH7fHqxLkQ9c9ikjG4zRN3NChssa5gfpLwrcEehoyV): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896401455 (313h44m44.493172478s) [noise=true , address=185.167.204.205:4010 , piece_id=7FSHYGXVLP2Z6UNB23KIO3SNQOPHR44L6NVEGQWWLZTTILQ6QEKA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896478198 (313h44m44.493249232s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12drdYnnWsuMyFo6LkcewAGGWnorRCAhxPpNqK41LvGy2zkBvng): protocol: expected piece hash; context canceled; EOF
Mar 19 12:44:46.896495749 (313h44m44.493266782s) [noise=true , address=81.171.14.70:4031 , piece_id=NC53BSJAOSITPXCUEH343UIYDQTWX6ALLC5HYFBJASFCKKCRJMDA, seg_pos={0 0}, upload=351443]: Long tail cancellation due to optimal threshold
Mar 19 12:44:46.896525129 (313h44m44.493296153s) [seg_pos={0 0}, upload=351443]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil>
Mar 19 12:44:46.896607372 (313h44m44.493378398s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Mar 19 12:44:46.896614099 (313h44m44.493385129s) [upload=351443]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Mar 19 12:44:47.031874892 (313h44m44.628645906s) [upload=351443]: Done uploading segments...
Mar 19 12:44:47.031907291 (313h44m44.628678315s) [upload=351443]: Upload finished. err: <nil>
Duration: 2.466147922s
core
uplink
eu-select-1
eu1-placement-15
|