Orbiter History

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................................................X] duration: 2m0.000680439s remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/7b444d46c222781f FAIL (2026-01-18 09:49:07 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 2m0.000718546s edge linksharing bgp ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 388.649681ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:21:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 388.759792ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 467.64632ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:20:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 467.773458ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 548.350446ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:20:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 548.382292ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 619.496524ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:19:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 619.518874ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 419.759787ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:19:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 419.783229ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 861.388463ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:18:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 861.414382ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 437.097148ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:18:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 437.120714ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 493.949762ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:17:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 493.979876ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 474.962801ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:16:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 474.989717ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 459.683722ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:16:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 459.703457ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 405.79907ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:15:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 405.82363ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 457.874168ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:14:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 457.921248ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 500.960826ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:13:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 501.003773ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 456.061407ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:13:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 456.089548ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 378.760167ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:12:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 378.786477ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 488.126858ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:11:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 488.151507ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 472.744268ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:10:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 472.768203ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 461.887607ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:09:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 461.909208ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 440.867858ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:08:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 440.890924ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 447.872635ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:07:52 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 447.898331ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 703.765946ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:07:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 703.788103ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 562.41034ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:06:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 562.483473ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 861.006959ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:05:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 861.036263ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 437.137937ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:05:25 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 437.171357ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 432.786085ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:04:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 432.815651ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 435.251005ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:03:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 435.277987ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 379.945357ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:02:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 379.975258ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 371.492836ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:01:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 371.519691ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 562.812436ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-18 00:00:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 562.845842ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 383.641278ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:59:50 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 383.662386ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 865.030938ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:58:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 865.058543ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 375.215967ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:58:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 375.244054ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 476.128761ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:57:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 476.151285ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 827.302463ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:56:33 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 827.340638ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 887.064831ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:56:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 887.101687ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 431.271291ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:55:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 431.287192ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 732.208313ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:54:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 732.263225ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 618.054037ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:53:34 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 618.073401ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 479.278378ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:53:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 479.303958ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 428.478851ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:52:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 428.507302ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 414.328757ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:51:00 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 414.377054ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 906.598666ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:50:31 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 906.625006ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 464.794495ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:50:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 464.824377ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 403.185055ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:49:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 403.21235ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 408.127835ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:49:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 408.179533ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 405.518716ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:48:45 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 405.543578ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 407.925453ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:47:35 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 407.954836ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 445.274164ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:47:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 445.519417ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 358.486322ms trace: https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0 FAIL (2026-01-17 23:46:27 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments... Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment... Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment. Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece... Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments... Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil> Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments... Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil> Duration: 358.512109ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)