Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
481.2665ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:45:50 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 481.292311ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
447.2749ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:45:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 447.298346ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
383.095247ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:44:27 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 383.121655ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
446.081723ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:43:41 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 446.135347ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
412.058928ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:42:48 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 412.091098ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
378.330779ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:42:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 378.362918ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
426.42523ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:41:10 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 426.460442ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
514.05034ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:40:19 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 514.073464ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
467.515486ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:39:07 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 467.540639ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
389.06362ms trace:
https://jaeger.dev.storj.io/trace/2840ba3e5c1bb5e0
FAIL (2026-01-17 23:37:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
Jan 17 23:36:58.080334426 (55h41m51.563791624s) [upload=57830]: Starting upload
Jan 17 23:36:58.080398094 (55h41m51.563855297s) [upload=57830]: Done starting upload
Jan 17 23:36:58.080433233 (55h41m51.563890421s) [upload=57830]: Uploading segments...
Jan 17 23:36:58.080686012 (55h41m51.564143211s) [upload=57830]: Got next segment. Inline: false
Jan 17 23:36:58.080734971 (55h41m51.564192171s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jan 17 23:36:58.080740336 (55h41m51.564197533s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jan 17 23:36:58.109968067 (55h41m51.593425264s) [seg_pos={0 0}, upload=57830]: Begin upload segment...
Jan 17 23:36:58.110044334 (55h41m51.593501531s) [seg_pos={0 0}, upload=57830]: Done begin upload segment.
Jan 17 23:36:58.110064953 (55h41m51.59352216s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110157992 (55h41m51.593615194s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.110667002 (55h41m51.594124199s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.111118278 (55h41m51.594575482s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115272025 (55h41m51.598729222s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.115776235 (55h41m51.599233432s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.116285036 (55h41m51.599742234s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.117795361 (55h41m51.601252564s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.119280832 (55h41m51.602738038s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.120715050 (55h41m51.604172256s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.122268682 (55h41m51.605725882s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.123956370 (55h41m51.607413576s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.124203073 (55h41m51.607660274s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.126220247 (55h41m51.609677445s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.127814142 (55h41m51.611271342s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.128570640 (55h41m51.612027844s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130102403 (55h41m51.613559604s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.130274259 (55h41m51.613731456s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Uploading piece...
Jan 17 23:36:58.178433883 (55h41m51.661891067s) [upload=57830]: Next returned nil segment
Jan 17 23:36:58.178446998 (55h41m51.661904195s) [upload=57830]: Waiting for error group managing segments...
Jan 17 23:36:58.183990333 (55h41m51.667447519s) [noise=true , address=45.91.116.7:4039 , piece_id=XAMISXQDXZ3PJ5GZROYHW3HFB7GCU5XKGLUNCEPCSIAUTPMFL5QA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.184643166 (55h41m51.668100353s) [noise=true , address=45.91.116.7:4043 , piece_id=5OSHL2ARF3RHYW5APWT22IO3IVINBVIYJ72BSNGPCG35RHBHRKIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185388796 (55h41m51.668845979s) [noise=true , address=45.91.116.11:4148 , piece_id=6WHWLJQIVQ3AZMID54LK2SDTJMX75PUZ76GJVFHIIXS5CXQ7UQTQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.185844099 (55h41m51.669301282s) [noise=true , address=45.91.116.14:4206 , piece_id=ENC2LOZL5JWRVVNHMEJPUO53JJJ6Z3FO26GA6BQQTSM44DM2QH6Q, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186176665 (55h41m51.669633849s) [noise=true , address=145.79.227.47:4276 , piece_id=SB66N6BGE7BYD3JER7BXWY4S2GALBW7ZW7USSRNXVIRGQXCPJBIA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186523272 (55h41m51.669980456s) [noise=true , address=45.91.116.10:4096 , piece_id=QFRUNXO7E7QCVXGHO34PZALPDFJHBXJ6LCQL6JGBTJBJDVPE3QMQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.186924576 (55h41m51.670381775s) [noise=true , address=77.90.31.12:4624 , piece_id=WLRKDEA7BY6R4X4ZYDIG4MVVMOBZI35ALM7KXTVWYVOTNUUGOHJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.197754229 (55h41m51.681211427s) [noise=true , address=45.91.116.14:4212 , piece_id=N5NHI733DMLL6XMGAPA2UIHTBNKRAEOLQ6GN4KGDQLDVJPS6R3XQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.198490574 (55h41m51.681947771s) [noise=true , address=45.91.116.9:4288 , piece_id=DFT4O5OSI2MZ6TKUPE5W6HIJWYJK5T2GNJJZTTQ5SZBPDCJWXMFQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.199623630 (55h41m51.683080818s) [noise=true , address=77.90.31.21:4910 , piece_id=O66LQJUNNO6QEYTOII2NMJI2OF7PZZFOIGADXM67I5QNMNVWYHHA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.207691335 (55h41m51.691148533s) [noise=true , address=77.90.31.11:4573 , piece_id=TO3FRPMFCVM3O6ZFI6TXDHL6UJINULAC7K2IOYJDM5Q44LXLW7IQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.254759448 (55h41m51.738216635s) [noise=true , address=77.90.31.15:4721 , piece_id=5B55DWOGCDIH6ZP5XWS6J6DXIPWTBR3WBWGNEU2OYK7PQKOUS36A, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.259986952 (55h41m51.74344414s) [noise=true , address=77.90.31.19:4850 , piece_id=SMD5JRE5XQEWXG7NF3IIXS2UYEZ4HCRES3LQW5NOY53SKRMFQCCA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296667486 (55h41m51.780124683s) [noise=true , address=77.90.31.10:4541 , piece_id=ZHWRURJH65Q4DYJIORDPPTW3I2F255ESGCODI2W4ET7VMSU4J3DA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: <nil>
Jan 17 23:36:58.296690810 (55h41m51.78014801s) [seg_pos={0 0}, upload=57830]: Satisfied cohort requirements after 14 pieces
Jan 17 23:36:58.297363832 (55h41m51.780821036s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297375765 (55h41m51.780832965s) [noise=true , address=45.91.116.8:4051 , piece_id=4EORN5UTXTEJVNGVBCVBLPOQBFIH5LHZG3BICUV6UK3KRJWPXIJA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.297951558 (55h41m51.781408767s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12LpFW1mfotWPqgQxyBSimChkttujx21L6rU2GRSwvqbZ7CVeLn): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.297984804 (55h41m51.781442006s) [noise=true , address=145.79.227.30:4791 , piece_id=LELKOOTKG3RWPDGXROKJ7EOS2XZKSQK4VUUT32KEZ4W7GALT76TA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298145078 (55h41m51.781602267s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: read tcp 159.223.143.39:42900->64.49.13.140:4516: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jan 17 23:36:58.298167920 (55h41m51.781625117s) [noise=true , address=64.49.13.140:4516 , piece_id=35J3VYC5GZBPRNXRTGS4M4SSGYI6TCE5IVAEEBCKZ2PMA4YW56ZA, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298321051 (55h41m51.781778257s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bN25eEEjxCWKJSr8qj7moDJxArgfsjzPTdBcLdfvoeyxiqPpc): protocol: expected piece hash; context canceled; EOF
Jan 17 23:36:58.298328429 (55h41m51.781785629s) [noise=true , address=145.79.227.48:4321 , piece_id=AV4Q7NV776WI3UP4WNZWAHK2TRJDKKLP2U5E34GFXQNHBOPE5DQQ, seg_pos={0 0}, upload=57830]: Long tail cancellation due to optimal threshold
Jan 17 23:36:58.298343913 (55h41m51.781801103s) [seg_pos={0 0}, upload=57830]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Jan 17 23:36:58.298486567 (55h41m51.781943766s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jan 17 23:36:58.298493859 (55h41m51.781951068s) [upload=57830]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jan 17 23:36:58.353605279 (55h41m51.837062468s) [upload=57830]: Done uploading segments...
Jan 17 23:36:58.353625581 (55h41m51.837082769s) [upload=57830]: Upload finished. err: <nil>
Duration: 389.091248ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
281.257668ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:40:33 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 281.285631ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
435.003584ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:39:18 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 435.030184ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
977.148963ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:38:34 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 977.174588ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
340.887472ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:37:40 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 340.9092ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
326.76719ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:36:39 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 326.790152ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
785.257308ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:35:51 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 785.283515ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
1.003492909s remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:35:34 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 1.003518124s
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
338.007502ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:35:02 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 338.055216ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
296.548161ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:34:19 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 296.569769ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
316.806299ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:34:02 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 316.83341ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
358.8849ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:33:45 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 358.905988ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
796.574446ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:33:31 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 796.595472ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
277.186941ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:33:09 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 277.274801ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
994.639982ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:32:25 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 994.662245ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
443.82489ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:32:24 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 443.918654ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
326.692438ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:31:41 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 326.712441ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
299.137435ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:31:30 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 299.160251ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
278.027159ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:31:16 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 278.057232ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
291.530156ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:30:43 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 291.569577ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
362.104251ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:30:13 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 362.128644ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
844.664813ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:30:08 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 844.691395ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
278.229671ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:29:55 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 278.250466ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
275.688434ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:29:05 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 275.71091ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
326.85144ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:29:04 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 326.878397ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
276.283875ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:28:27 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 276.297589ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
343.574432ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:28:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 343.599426ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
330.306193ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:27:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 330.327846ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
283.051989ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:27:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 283.074043ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
290.734512ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:27:04 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 290.77477ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
277.827925ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:26:53 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 277.883579ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
840.603339ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:26:23 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 840.628098ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
289.51464ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:26:05 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 289.553048ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
979.526302ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:25:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 979.551773ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
332.479782ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:24:58 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 332.505128ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
327.66924ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:24:06 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 327.754016ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
285.858657ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:23:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 285.882168ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
285.66327ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:23:25 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 285.687956ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
289.408037ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:23:21 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 289.429101ms
edge
linksharing
bgp
ap1
|
checkers.HTTP{"GET" "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.ap1.gateway)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
293.573945ms remote:
"tcp:136.0.77.3:443" target:
https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011 trace:
https://jaeger.dev.storj.io/trace/2842feb65a8cc27b
FAIL (2026-01-17 19:22:59 UTC)
orbiter warning: Get "https://uptime-checks.gateway.storjshare.io/hello-world.txt?AWSAccessKeyId=jwlk53gfhsby563unjoqoivp56jq&Signature=Q7FkmqtUH%2BgeU7PdNdPIPgOXqhY%3D&Expires=1771549011": context deadline exceeded
Duration: 293.602914ms
edge
gateway
vhost
bgp
ap1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
284.666008ms remote:
"tcp:136.0.77.4:443" target:
https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/f11f4d969c414f6
FAIL (2026-01-17 19:22:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 284.699837ms
edge
linksharing
bgp
ap1
|