Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................XX...X..................] duration: 467.511913ms FAIL (2025-10-27 12:57:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 467.544058ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 204.972266ms FAIL (2025-10-27 12:56:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 205.017531ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................XX...X.................] duration: 394.844164ms FAIL (2025-10-27 12:56:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 394.88273ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 216.890956ms FAIL (2025-10-27 12:56:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 216.922765ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................XX...X................] duration: 440.705758ms FAIL (2025-10-27 12:56:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 440.811508ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................XX...X...............] duration: 372.994605ms FAIL (2025-10-27 12:55:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 373.035618ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 212.767932ms FAIL (2025-10-27 12:55:10 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 212.843805ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................XX...X..............] duration: 391.179301ms FAIL (2025-10-27 12:54:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 391.21071ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 332.439847ms FAIL (2025-10-27 12:54:53 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 332.55294ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 339.201427ms FAIL (2025-10-27 12:54:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 339.325607ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................XX...X.............] duration: 654.540189ms FAIL (2025-10-27 12:54:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 654.59395ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................................XX...X............] duration: 363.352674ms FAIL (2025-10-27 12:53:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 363.400061ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 222.152302ms FAIL (2025-10-27 12:53:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 222.206345ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................................XX...X...........] duration: 416.12211ms FAIL (2025-10-27 12:53:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 416.167453ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................................XX...X..........] duration: 400.212306ms FAIL (2025-10-27 12:52:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 400.240075ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 207.135817ms FAIL (2025-10-27 12:52:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 207.167856ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 181.231963ms FAIL (2025-10-27 12:51:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 181.33247ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................................XX...X.........] duration: 387.616098ms FAIL (2025-10-27 12:51:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 387.648658ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 231.577629ms FAIL (2025-10-27 12:50:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 231.614895ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................................XX...X........] duration: 456.126115ms FAIL (2025-10-27 12:50:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 456.176137ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................................XX...X.......] duration: 580.014661ms FAIL (2025-10-27 12:50:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 580.062157ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 290.976735ms FAIL (2025-10-27 12:49:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 291.007338ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 208.721972ms FAIL (2025-10-27 12:49:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 208.754634ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................................XX...X......] duration: 448.282059ms FAIL (2025-10-27 12:48:57 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 448.317361ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 235.369404ms FAIL (2025-10-27 12:48:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 235.400432ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................................XX...X.....] duration: 846.65012ms FAIL (2025-10-27 12:48:11 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 846.754818ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 207.382102ms FAIL (2025-10-27 12:47:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 207.421388ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................................XX...X....] duration: 423.999468ms FAIL (2025-10-27 12:47:33 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 424.031776ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................................XX...X...] duration: 411.996873ms FAIL (2025-10-27 12:47:18 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 412.02745ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................................XX...X..] duration: 592.81139ms FAIL (2025-10-27 12:47:02 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 592.876977ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 225.595812ms FAIL (2025-10-27 12:46:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 225.6381ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................................XX...X.] duration: 459.718267ms FAIL (2025-10-27 12:46:39 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 459.742839ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................................XX...X] duration: 1m0.02951296s FAIL (2025-10-27 12:46:38 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.029537859s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 203.820501ms FAIL (2025-10-27 12:46:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 203.880372ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 282.138798ms FAIL (2025-10-27 12:45:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 282.1703ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 234.229926ms FAIL (2025-10-27 12:44:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 234.281738ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................................XX...] duration: 594.292042ms FAIL (2025-10-27 12:44:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:26.982297090 (733h24m12.892668955s) [upload=762194]: Starting upload Oct 27 12:42:26.982379266 (733h24m12.892751135s) [upload=762194]: Done starting upload Oct 27 12:42:26.982709455 (733h24m12.893081327s) [upload=762194]: Uploading segments... Oct 27 12:42:26.982818590 (733h24m12.893190467s) [upload=762194]: Got next segment. Inline: false Oct 27 12:42:26.982899551 (733h24m12.893271413s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:26.982906056 (733h24m12.893277925s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:42:27.031197323 (733h24m12.941569181s) [seg_pos={0 0}, upload=762194]: Begin upload segment... Oct 27 12:42:27.031256363 (733h24m12.941628226s) [seg_pos={0 0}, upload=762194]: Done begin upload segment. Oct 27 12:42:27.031282645 (733h24m12.941654504s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031365928 (733h24m12.941737796s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031928936 (733h24m12.942300806s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031941848 (733h24m12.942313709s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032423333 (733h24m12.942795191s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032446156 (733h24m12.942818025s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032790470 (733h24m12.943162342s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032845703 (733h24m12.943217578s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033173738 (733h24m12.943545596s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033645236 (733h24m12.944017094s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033810979 (733h24m12.944182834s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034078163 (733h24m12.944450032s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034487828 (733h24m12.944859704s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034887454 (733h24m12.945259311s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035401770 (733h24m12.945773638s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035835385 (733h24m12.946207253s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036198659 (733h24m12.946570518s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036877252 (733h24m12.94724912s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.117143177 (733h24m13.027515035s) [upload=762194]: Next returned nil segment Oct 27 12:42:27.117173557 (733h24m13.027545426s) [upload=762194]: Waiting for error group managing segments... Oct 27 12:42:27.124018925 (733h24m13.03439078s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124273263 (733h24m13.034645124s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124368636 (733h24m13.034740491s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124991804 (733h24m13.035363661s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.125121504 (733h24m13.035493366s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.127415366 (733h24m13.037787221s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.131243926 (733h24m13.041615788s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133046871 (733h24m13.043418729s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133192198 (733h24m13.043564059s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.136432101 (733h24m13.046803963s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.137657997 (733h24m13.048029865s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.139495480 (733h24m13.04986734s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.142633460 (733h24m13.053005322s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145137694 (733h24m13.055509552s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145164601 (733h24m13.055536468s) [seg_pos={0 0}, upload=762194]: Segment reached optimal threshold of 14 pieces. Oct 27 12:42:27.145375529 (733h24m13.05574739s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dSS7NcpaDB98oZdBM6vFe56mejA8fJZKA5YvERXTD9qqXVPdH): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145388752 (733h24m13.055760624s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145429056 (733h24m13.055800914s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145450128 (733h24m13.055821999s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145458371 (733h24m13.055830232s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wcX8iEhi5LrftcXUQE3Lrm4igNwhDtvT3RNBERTGsKyQ6KLj6): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145468032 (733h24m13.055839901s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145474709 (733h24m13.055846571s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145481066 (733h24m13.055852934s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145494854 (733h24m13.055866721s) [seg_pos={0 0}, upload=762194]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 27 12:42:27.145609563 (733h24m13.055981434s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:42:27.145616316 (733h24m13.055988174s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:26.960718282 (733h25m12.871090144s) [upload=762194]: Done uploading segments... Oct 27 12:43:26.960759985 (733h25m12.87113186s) [upload=762194]: Upload finished. err: metaclient: context deadline exceeded Duration: 594.332186ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 244.052244ms FAIL (2025-10-27 12:44:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 244.088727ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................XX..] duration: 401.249678ms FAIL (2025-10-27 12:44:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:26.982297090 (733h24m12.892668955s) [upload=762194]: Starting upload Oct 27 12:42:26.982379266 (733h24m12.892751135s) [upload=762194]: Done starting upload Oct 27 12:42:26.982709455 (733h24m12.893081327s) [upload=762194]: Uploading segments... Oct 27 12:42:26.982818590 (733h24m12.893190467s) [upload=762194]: Got next segment. Inline: false Oct 27 12:42:26.982899551 (733h24m12.893271413s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:26.982906056 (733h24m12.893277925s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:42:27.031197323 (733h24m12.941569181s) [seg_pos={0 0}, upload=762194]: Begin upload segment... Oct 27 12:42:27.031256363 (733h24m12.941628226s) [seg_pos={0 0}, upload=762194]: Done begin upload segment. Oct 27 12:42:27.031282645 (733h24m12.941654504s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031365928 (733h24m12.941737796s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031928936 (733h24m12.942300806s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031941848 (733h24m12.942313709s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032423333 (733h24m12.942795191s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032446156 (733h24m12.942818025s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032790470 (733h24m12.943162342s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032845703 (733h24m12.943217578s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033173738 (733h24m12.943545596s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033645236 (733h24m12.944017094s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033810979 (733h24m12.944182834s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034078163 (733h24m12.944450032s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034487828 (733h24m12.944859704s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034887454 (733h24m12.945259311s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035401770 (733h24m12.945773638s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035835385 (733h24m12.946207253s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036198659 (733h24m12.946570518s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036877252 (733h24m12.94724912s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.117143177 (733h24m13.027515035s) [upload=762194]: Next returned nil segment Oct 27 12:42:27.117173557 (733h24m13.027545426s) [upload=762194]: Waiting for error group managing segments... Oct 27 12:42:27.124018925 (733h24m13.03439078s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124273263 (733h24m13.034645124s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124368636 (733h24m13.034740491s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124991804 (733h24m13.035363661s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.125121504 (733h24m13.035493366s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.127415366 (733h24m13.037787221s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.131243926 (733h24m13.041615788s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133046871 (733h24m13.043418729s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133192198 (733h24m13.043564059s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.136432101 (733h24m13.046803963s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.137657997 (733h24m13.048029865s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.139495480 (733h24m13.04986734s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.142633460 (733h24m13.053005322s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145137694 (733h24m13.055509552s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145164601 (733h24m13.055536468s) [seg_pos={0 0}, upload=762194]: Segment reached optimal threshold of 14 pieces. Oct 27 12:42:27.145375529 (733h24m13.05574739s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dSS7NcpaDB98oZdBM6vFe56mejA8fJZKA5YvERXTD9qqXVPdH): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145388752 (733h24m13.055760624s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145429056 (733h24m13.055800914s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145450128 (733h24m13.055821999s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145458371 (733h24m13.055830232s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wcX8iEhi5LrftcXUQE3Lrm4igNwhDtvT3RNBERTGsKyQ6KLj6): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145468032 (733h24m13.055839901s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145474709 (733h24m13.055846571s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145481066 (733h24m13.055852934s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145494854 (733h24m13.055866721s) [seg_pos={0 0}, upload=762194]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 27 12:42:27.145609563 (733h24m13.055981434s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:42:27.145616316 (733h24m13.055988174s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:26.960718282 (733h25m12.871090144s) [upload=762194]: Done uploading segments... Oct 27 12:43:26.960759985 (733h25m12.87113186s) [upload=762194]: Upload finished. err: metaclient: context deadline exceeded Duration: 401.280909ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................XX.] duration: 495.141877ms FAIL (2025-10-27 12:43:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:26.982297090 (733h24m12.892668955s) [upload=762194]: Starting upload Oct 27 12:42:26.982379266 (733h24m12.892751135s) [upload=762194]: Done starting upload Oct 27 12:42:26.982709455 (733h24m12.893081327s) [upload=762194]: Uploading segments... Oct 27 12:42:26.982818590 (733h24m12.893190467s) [upload=762194]: Got next segment. Inline: false Oct 27 12:42:26.982899551 (733h24m12.893271413s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:26.982906056 (733h24m12.893277925s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:42:27.031197323 (733h24m12.941569181s) [seg_pos={0 0}, upload=762194]: Begin upload segment... Oct 27 12:42:27.031256363 (733h24m12.941628226s) [seg_pos={0 0}, upload=762194]: Done begin upload segment. Oct 27 12:42:27.031282645 (733h24m12.941654504s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031365928 (733h24m12.941737796s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031928936 (733h24m12.942300806s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031941848 (733h24m12.942313709s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032423333 (733h24m12.942795191s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032446156 (733h24m12.942818025s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032790470 (733h24m12.943162342s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032845703 (733h24m12.943217578s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033173738 (733h24m12.943545596s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033645236 (733h24m12.944017094s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033810979 (733h24m12.944182834s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034078163 (733h24m12.944450032s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034487828 (733h24m12.944859704s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034887454 (733h24m12.945259311s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035401770 (733h24m12.945773638s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035835385 (733h24m12.946207253s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036198659 (733h24m12.946570518s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036877252 (733h24m12.94724912s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.117143177 (733h24m13.027515035s) [upload=762194]: Next returned nil segment Oct 27 12:42:27.117173557 (733h24m13.027545426s) [upload=762194]: Waiting for error group managing segments... Oct 27 12:42:27.124018925 (733h24m13.03439078s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124273263 (733h24m13.034645124s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124368636 (733h24m13.034740491s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124991804 (733h24m13.035363661s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.125121504 (733h24m13.035493366s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.127415366 (733h24m13.037787221s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.131243926 (733h24m13.041615788s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133046871 (733h24m13.043418729s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133192198 (733h24m13.043564059s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.136432101 (733h24m13.046803963s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.137657997 (733h24m13.048029865s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.139495480 (733h24m13.04986734s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.142633460 (733h24m13.053005322s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145137694 (733h24m13.055509552s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145164601 (733h24m13.055536468s) [seg_pos={0 0}, upload=762194]: Segment reached optimal threshold of 14 pieces. Oct 27 12:42:27.145375529 (733h24m13.05574739s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dSS7NcpaDB98oZdBM6vFe56mejA8fJZKA5YvERXTD9qqXVPdH): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145388752 (733h24m13.055760624s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145429056 (733h24m13.055800914s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145450128 (733h24m13.055821999s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145458371 (733h24m13.055830232s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wcX8iEhi5LrftcXUQE3Lrm4igNwhDtvT3RNBERTGsKyQ6KLj6): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145468032 (733h24m13.055839901s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145474709 (733h24m13.055846571s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145481066 (733h24m13.055852934s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145494854 (733h24m13.055866721s) [seg_pos={0 0}, upload=762194]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 27 12:42:27.145609563 (733h24m13.055981434s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:42:27.145616316 (733h24m13.055988174s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:26.960718282 (733h25m12.871090144s) [upload=762194]: Done uploading segments... Oct 27 12:43:26.960759985 (733h25m12.87113186s) [upload=762194]: Upload finished. err: metaclient: context deadline exceeded Duration: 495.178613ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.020997945s FAIL (2025-10-27 12:43:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:26.982297090 (733h24m12.892668955s) [upload=762194]: Starting upload Oct 27 12:42:26.982379266 (733h24m12.892751135s) [upload=762194]: Done starting upload Oct 27 12:42:26.982709455 (733h24m12.893081327s) [upload=762194]: Uploading segments... Oct 27 12:42:26.982818590 (733h24m12.893190467s) [upload=762194]: Got next segment. Inline: false Oct 27 12:42:26.982899551 (733h24m12.893271413s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:26.982906056 (733h24m12.893277925s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:42:27.031197323 (733h24m12.941569181s) [seg_pos={0 0}, upload=762194]: Begin upload segment... Oct 27 12:42:27.031256363 (733h24m12.941628226s) [seg_pos={0 0}, upload=762194]: Done begin upload segment. Oct 27 12:42:27.031282645 (733h24m12.941654504s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031365928 (733h24m12.941737796s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031928936 (733h24m12.942300806s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.031941848 (733h24m12.942313709s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032423333 (733h24m12.942795191s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032446156 (733h24m12.942818025s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032790470 (733h24m12.943162342s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.032845703 (733h24m12.943217578s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033173738 (733h24m12.943545596s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033645236 (733h24m12.944017094s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.033810979 (733h24m12.944182834s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034078163 (733h24m12.944450032s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034487828 (733h24m12.944859704s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.034887454 (733h24m12.945259311s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035401770 (733h24m12.945773638s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.035835385 (733h24m12.946207253s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036198659 (733h24m12.946570518s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.036877252 (733h24m12.94724912s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Uploading piece... Oct 27 12:42:27.117143177 (733h24m13.027515035s) [upload=762194]: Next returned nil segment Oct 27 12:42:27.117173557 (733h24m13.027545426s) [upload=762194]: Waiting for error group managing segments... Oct 27 12:42:27.124018925 (733h24m13.03439078s) [noise=true , address=77.90.31.14:4688 , piece_id=L6MXET4JIAKOZIT2X4NAZZ22277PYSQVSTZA7635QHU3X4V5XICQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124273263 (733h24m13.034645124s) [noise=true , address=45.91.116.11:4140 , piece_id=AHZYCSET3ODGM4KAGV3R2FKBW62VGL7RNYCDK62RSDUS6ASJWWGQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124368636 (733h24m13.034740491s) [noise=true , address=45.91.116.4:4951 , piece_id=M5TXO5EJLTDOBBOX6PCZOD5UMHAG6JDHOFNVHCD4QD2I5KU3X4DQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.124991804 (733h24m13.035363661s) [noise=true , address=145.79.227.50:4405 , piece_id=QRCCUPG3TRCWWRR7HBI7VDOWLXLKOFKKAJTX6SYKU2VNTGXVOQ4A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.125121504 (733h24m13.035493366s) [noise=true , address=77.90.31.19:4852 , piece_id=4D4H5SB5V6DQANXP2X7PVAJ3WJYM46EYBTKHSEQTHBIU2G6E2QMQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.127415366 (733h24m13.037787221s) [noise=true , address=145.79.227.16:4933 , piece_id=WB6RUBPQYZLKQF7WO57IPC4CYSPESYNN4L4AGFXNLB2JNRKNHK7Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.131243926 (733h24m13.041615788s) [noise=true , address=45.91.116.12:4241 , piece_id=LG7SBLFEN34E3B7L7H4EUHKJEKKHII6BKE3SPMXQXONSYETZWGBQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133046871 (733h24m13.043418729s) [noise=true , address=45.91.116.10:4096 , piece_id=H36XVMNZZPIT257RYGJEHH6LHQUZWSTM6G7BIOQZPSFK5Y6T276A, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.133192198 (733h24m13.043564059s) [noise=true , address=45.91.116.8:4046 , piece_id=LRSROHV2X67M5HY4XVX764O7TAKCGUTLQGETXT5Q5O7CDHOGQDJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.136432101 (733h24m13.046803963s) [noise=true , address=77.90.31.10:4539 , piece_id=6IYYI3TBGH4GJIPTUFZQXQDOLPVLQQ76BLYN7YON7K36XCREEUJQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.137657997 (733h24m13.048029865s) [noise=true , address=77.90.31.17:4785 , piece_id=MFYJECPUCZLP2LITVWGJUYJDZ4BUCS2XIHXO5RXGAHNCNS2BB35Q, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.139495480 (733h24m13.04986734s) [noise=true , address=45.91.116.6:4982 , piece_id=KBFKMSJQYQXF2ZOGF44CXVLK5MFI3ZJNZVRLCFRS7ZCD7HF6LOYQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.142633460 (733h24m13.053005322s) [noise=true , address=145.79.227.2:4122 , piece_id=L3RMGRYN5DKJN3MAHXNPWMD6XV76NNXCIKBFWYPLQEJUHSXBY2XA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145137694 (733h24m13.055509552s) [noise=true , address=145.79.227.44:4195 , piece_id=LKJ56OJPELQW67M4OSGIF5C5OG2647OMCNHV6S7RX373Z3DRQPWA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: <nil> Oct 27 12:42:27.145164601 (733h24m13.055536468s) [seg_pos={0 0}, upload=762194]: Segment reached optimal threshold of 14 pieces. Oct 27 12:42:27.145375529 (733h24m13.05574739s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dSS7NcpaDB98oZdBM6vFe56mejA8fJZKA5YvERXTD9qqXVPdH): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145388752 (733h24m13.055760624s) [noise=true , address=77.90.31.18:4821 , piece_id=QBAY3HT5JKKOIG5MWPEZC2FRZHMPO45LL2C53TRYZ52WJGRHRPXA, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145429056 (733h24m13.055800914s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129B3N7yjJvwCzoVLTqWsPbcLQ5TQUyAzg1RCkbSAVKPWYTG8eb): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145450128 (733h24m13.055821999s) [noise=true , address=77.90.31.16:4739 , piece_id=RSM23JIQ5COFZW7JVGER7Q3SZKW5S2MGRYSEHVSU2YNRG2GZKHZQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145458371 (733h24m13.055830232s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wcX8iEhi5LrftcXUQE3Lrm4igNwhDtvT3RNBERTGsKyQ6KLj6): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145468032 (733h24m13.055839901s) [noise=true , address=77.90.31.21:4889 , piece_id=Y6XQAUOBBO43TXR5O7WOQYV2B7KIFLNA5EXVATQEMRNQ5RUPZFXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145474709 (733h24m13.055846571s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks): protocol: expected piece hash; context canceled; EOF Oct 27 12:42:27.145481066 (733h24m13.055852934s) [noise=true , address=77.90.31.11:4556 , piece_id=KPQO5JQVMBVGQTJJ6A5EJKUGM7DLO6QMXJWMN3RYZPMPQBI4KOXQ, seg_pos={0 0}, upload=762194]: Long tail cancellation due to optimal threshold Oct 27 12:42:27.145494854 (733h24m13.055866721s) [seg_pos={0 0}, upload=762194]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 27 12:42:27.145609563 (733h24m13.055981434s) [upload=762194]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:42:27.145616316 (733h24m13.055988174s) [upload=762194]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:26.960718282 (733h25m12.871090144s) [upload=762194]: Done uploading segments... Oct 27 12:43:26.960759985 (733h25m12.87113186s) [upload=762194]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.021020072s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 319.944268ms FAIL (2025-10-27 12:43:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 319.974784ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.001610065s FAIL (2025-10-27 12:43:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 1m0.001674112s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.060597242s FAIL (2025-10-27 12:42:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:41:26.858104785 (733h23m12.768476655s) [upload=762175]: Starting upload Oct 27 12:41:26.858181291 (733h23m12.768553167s) [upload=762175]: Done starting upload Oct 27 12:41:26.858253350 (733h23m12.768625224s) [upload=762175]: Uploading segments... Oct 27 12:41:26.858550092 (733h23m12.768921963s) [upload=762175]: Got next segment. Inline: false Oct 27 12:41:26.858604207 (733h23m12.768976077s) [upload=762175]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:41:26.858610658 (733h23m12.768982534s) [upload=762175]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:41:26.908369574 (733h23m12.818741451s) [seg_pos={0 0}, upload=762175]: Begin upload segment... Oct 27 12:41:26.908441254 (733h23m12.81881313s) [seg_pos={0 0}, upload=762175]: Done begin upload segment. Oct 27 12:41:26.908468950 (733h23m12.818840821s) [noise=true , address=45.91.116.11:4140 , piece_id=KQJPL5DKXZ737JQ3KPI7WWBPBLTFDOFIYVC7Y4IFZL3ZMFY2PUOA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.908493131 (733h23m12.818865035s) [noise=true , address=77.90.31.13:4652 , piece_id=SVA7EITLGD75M2VQBX6N46X4EBA4BDA3TN4QSAPD6IZ7UUIC74GQ, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.909198335 (733h23m12.81957021s) [noise=true , address=77.90.31.18:4831 , piece_id=6RSEWPPDC23UNFFVBZ44TLF3Z6MJROMXRUS7I55EN23OJKXTEHGQ, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.909797430 (733h23m12.820169307s) [noise=true , address=145.79.227.20:4470 , piece_id=AFH2P4B6OZFES346CJEOD337B2POJA4LJ6W7OVVMES3UBZUGAY7A, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.910318431 (733h23m12.820690309s) [noise=true , address=77.90.31.11:4572 , piece_id=PZZLST5GDHOP6CWEKSRZMFAIBUN6R7QUSQAMCWKY3QJKCS4FPRHA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.910753291 (733h23m12.821125168s) [noise=true , address=145.79.227.5:4242 , piece_id=XUUAEWOYYE7AHZW4CK6MTAHWFCITGLIB54LIMZPCLGW5QWRT4PQA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.911221908 (733h23m12.821593787s) [noise=true , address=77.90.31.14:4683 , piece_id=2SX6KNEI64ZHOLV6DJXPYKALAE66KEI6CA7VQEBSNOZQXRRJGHLA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.911316611 (733h23m12.821688489s) [noise=true , address=77.90.31.21:4887 , piece_id=ELDXKHB7NRKNYGSGQQTURBHITEMAMOABLCLF4AMOJWLXMB6ZMVXQ, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.911695805 (733h23m12.822067688s) [noise=true , address=145.79.227.14:4845 , piece_id=W4FWBHFPIOFYOXCRLDW42X23J3WDNCPUUASPNFGVJPL5DSTJ42LA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.911732340 (733h23m12.822104211s) [noise=true , address=145.79.227.4:4219 , piece_id=DSR7WOAJMS3ZHQ6X5C6MRSHSVRSMQ3MOPPKFFJQIEIDKE7C3FNZA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.912101614 (733h23m12.822473485s) [noise=true , address=145.79.227.46:4628 , piece_id=C5INE4CPTCATVUY6UYQPT5GTWLPAXOBJPCQL5RVK2LPT4X6TJUDA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.912119156 (733h23m12.822491033s) [noise=true , address=77.90.31.17:4794 , piece_id=AUQPTRPZ3AVA2KAJMVGHJO25WOGQJFRQUFUA75XSCTRHNJJWSKYQ, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.912567259 (733h23m12.822939138s) [noise=true , address=145.79.227.7:4305 , piece_id=JAG5ERUMZSCNE3YOHAVXMHWKI44U5Q7O5NG3OI4XZC6YM4TCJW5Q, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.912627994 (733h23m12.822999874s) [noise=true , address=77.90.31.12:4602 , piece_id=5RSYFHTLNORDANA22X7ZJ65DPYFCAIVML3JRVNEBPAQKE7FFLORQ, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.913018291 (733h23m12.823390159s) [noise=true , address=45.91.116.6:4997 , piece_id=KP66JZLXKBBK6H7I26JRCNSMOA6N6WOYBZYYINBWYMYGFIRG233A, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.913081909 (733h23m12.823453787s) [noise=true , address=77.90.31.15:4712 , piece_id=IEZ4VXGJDDFHCTKJU5OXVPVRGTEX7UK5LXFE6T6OSDRGN2ULJE7Q, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.913610176 (733h23m12.823982044s) [noise=true , address=45.91.116.14:4221 , piece_id=EVF32Y2ZMMTAOR3TNK7NFDRQRCMSZYR5DMHBEW5XBGNDFRDVBMQQ, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:26.913977324 (733h23m12.824349193s) [noise=true , address=45.91.116.5:4313 , piece_id=DG7ZOPZCWTF2DDVTGVDEMW33FLYZZ6QNP22MGILAZWTXN2GCFKOA, seg_pos={0 0}, upload=762175]: Uploading piece... Oct 27 12:41:27.003012441 (733h23m12.913384303s) [upload=762175]: Next returned nil segment Oct 27 12:41:27.003047603 (733h23m12.913419472s) [upload=762175]: Waiting for error group managing segments... Oct 27 12:41:27.009181872 (733h23m12.919553747s) [noise=true , address=77.90.31.12:4602 , piece_id=5RSYFHTLNORDANA22X7ZJ65DPYFCAIVML3JRVNEBPAQKE7FFLORQ, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.009307894 (733h23m12.91967977s) [noise=true , address=77.90.31.21:4887 , piece_id=ELDXKHB7NRKNYGSGQQTURBHITEMAMOABLCLF4AMOJWLXMB6ZMVXQ, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.009965122 (733h23m12.920336997s) [noise=true , address=145.79.227.4:4219 , piece_id=DSR7WOAJMS3ZHQ6X5C6MRSHSVRSMQ3MOPPKFFJQIEIDKE7C3FNZA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.011186047 (733h23m12.921557908s) [noise=true , address=77.90.31.13:4652 , piece_id=SVA7EITLGD75M2VQBX6N46X4EBA4BDA3TN4QSAPD6IZ7UUIC74GQ, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.014690589 (733h23m12.92506245s) [noise=true , address=77.90.31.15:4712 , piece_id=IEZ4VXGJDDFHCTKJU5OXVPVRGTEX7UK5LXFE6T6OSDRGN2ULJE7Q, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.014905566 (733h23m12.925277424s) [noise=true , address=77.90.31.17:4794 , piece_id=AUQPTRPZ3AVA2KAJMVGHJO25WOGQJFRQUFUA75XSCTRHNJJWSKYQ, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.021478122 (733h23m12.931849976s) [noise=true , address=45.91.116.14:4221 , piece_id=EVF32Y2ZMMTAOR3TNK7NFDRQRCMSZYR5DMHBEW5XBGNDFRDVBMQQ, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.024110261 (733h23m12.934482141s) [noise=true , address=77.90.31.18:4831 , piece_id=6RSEWPPDC23UNFFVBZ44TLF3Z6MJROMXRUS7I55EN23OJKXTEHGQ, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.026538644 (733h23m12.936910503s) [noise=true , address=45.91.116.11:4140 , piece_id=KQJPL5DKXZ737JQ3KPI7WWBPBLTFDOFIYVC7Y4IFZL3ZMFY2PUOA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.027550478 (733h23m12.93792234s) [noise=true , address=45.91.116.6:4997 , piece_id=KP66JZLXKBBK6H7I26JRCNSMOA6N6WOYBZYYINBWYMYGFIRG233A, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.036333145 (733h23m12.946705014s) [noise=true , address=145.79.227.46:4628 , piece_id=C5INE4CPTCATVUY6UYQPT5GTWLPAXOBJPCQL5RVK2LPT4X6TJUDA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.038564868 (733h23m12.948936728s) [noise=true , address=77.90.31.14:4683 , piece_id=2SX6KNEI64ZHOLV6DJXPYKALAE66KEI6CA7VQEBSNOZQXRRJGHLA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.042194770 (733h23m12.952566639s) [noise=true , address=77.90.31.11:4572 , piece_id=PZZLST5GDHOP6CWEKSRZMFAIBUN6R7QUSQAMCWKY3QJKCS4FPRHA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.049809288 (733h23m12.960181149s) [noise=true , address=145.79.227.14:4845 , piece_id=W4FWBHFPIOFYOXCRLDW42X23J3WDNCPUUASPNFGVJPL5DSTJ42LA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: <nil> Oct 27 12:41:27.049842728 (733h23m12.96021459s) [seg_pos={0 0}, upload=762175]: Segment reached optimal threshold of 14 pieces. Oct 27 12:41:27.049990506 (733h23m12.960362363s) [noise=true , address=145.79.227.20:4470 , piece_id=AFH2P4B6OZFES346CJEOD337B2POJA4LJ6W7OVVMES3UBZUGAY7A, seg_pos={0 0}, upload=762175]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZbWCEiPuqJqMhz88MJZrw7ar8wrV5abTTagADXTpnU8NQ8zYH): protocol: expected piece hash; context canceled; EOF Oct 27 12:41:27.049999949 (733h23m12.960371818s) [noise=true , address=145.79.227.20:4470 , piece_id=AFH2P4B6OZFES346CJEOD337B2POJA4LJ6W7OVVMES3UBZUGAY7A, seg_pos={0 0}, upload=762175]: Long tail cancellation due to optimal threshold Oct 27 12:41:27.050140348 (733h23m12.960512207s) [noise=true , address=145.79.227.7:4305 , piece_id=JAG5ERUMZSCNE3YOHAVXMHWKI44U5Q7O5NG3OI4XZC6YM4TCJW5Q, seg_pos={0 0}, upload=762175]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZMhNJYCNg8K16ZqsVTLBCwGn51vtG5u56cxcqgZPfQaJxgNZv): protocol: expected piece hash; context canceled; EOF Oct 27 12:41:27.050147639 (733h23m12.960519514s) [noise=true , address=145.79.227.7:4305 , piece_id=JAG5ERUMZSCNE3YOHAVXMHWKI44U5Q7O5NG3OI4XZC6YM4TCJW5Q, seg_pos={0 0}, upload=762175]: Long tail cancellation due to optimal threshold Oct 27 12:41:27.050215202 (733h23m12.96058707s) [noise=true , address=145.79.227.5:4242 , piece_id=XUUAEWOYYE7AHZW4CK6MTAHWFCITGLIB54LIMZPCLGW5QWRT4PQA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1inR8rjUp4fRQWcaD2S7MRxveHyFxKoutWoEiuKQG3C895PaMz): protocol: expected piece hash; context canceled; EOF Oct 27 12:41:27.050221153 (733h23m12.960593022s) [noise=true , address=145.79.227.5:4242 , piece_id=XUUAEWOYYE7AHZW4CK6MTAHWFCITGLIB54LIMZPCLGW5QWRT4PQA, seg_pos={0 0}, upload=762175]: Long tail cancellation due to optimal threshold Oct 27 12:41:27.050289171 (733h23m12.96066103s) [noise=true , address=45.91.116.5:4313 , piece_id=DG7ZOPZCWTF2DDVTGVDEMW33FLYZZ6QNP22MGILAZWTXN2GCFKOA, seg_pos={0 0}, upload=762175]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1LVXge8vYMEqzyAF4NWhqQBtw4KXUPXcTPTUMwViQuZkXetkJV): protocol: expected piece hash; context canceled; EOF Oct 27 12:41:27.050296759 (733h23m12.960668636s) [noise=true , address=45.91.116.5:4313 , piece_id=DG7ZOPZCWTF2DDVTGVDEMW33FLYZZ6QNP22MGILAZWTXN2GCFKOA, seg_pos={0 0}, upload=762175]: Long tail cancellation due to optimal threshold Oct 27 12:41:27.050315083 (733h23m12.96068695s) [seg_pos={0 0}, upload=762175]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Oct 27 12:41:27.050426090 (733h23m12.960797966s) [upload=762175]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:41:27.050434574 (733h23m12.960806447s) [upload=762175]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:42:26.869966176 (733h24m12.780338045s) [upload=762175]: Done uploading segments... Oct 27 12:42:26.869999001 (733h24m12.78037087s) [upload=762175]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.060623391s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 234.274968ms FAIL (2025-10-27 12:39:50 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725724A80B495C, HostID: , api error SlowDown: Please reduce your request rate. Duration: 234.323724ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 265.1568ms FAIL (2025-10-27 12:38:43 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725724A80B495C, HostID: , api error SlowDown: Please reduce your request rate. Duration: 265.271115ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 263.288764ms FAIL (2025-10-27 12:37:45 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725724A80B495C, HostID: , api error SlowDown: Please reduce your request rate. Duration: 263.311731ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 401.654276ms FAIL (2025-10-27 12:36:44 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725724A80B495C, HostID: , api error SlowDown: Please reduce your request rate. Duration: 401.678333ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 254.821949ms FAIL (2025-10-27 12:36:22 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725724A80B495C, HostID: , api error SlowDown: Please reduce your request rate. Duration: 254.846376ms edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 292.915579ms FAIL (2025-10-27 12:35:44 UTC) orbiter warning: operation error S3: PutObject, exceeded maximum number of attempts, 3, https response error StatusCode: 429, RequestID: 18725724A80B495C, HostID: , api error SlowDown: Please reduce your request rate. Duration: 292.963958ms edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)