Orbiter History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 36.412351ms target: https://us1.storj.io/login FAIL (2025-10-27 19:07:18 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 36.439353ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 29.951221ms target: https://us1.storj.io/login FAIL (2025-10-27 19:06:42 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 29.971089ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 31.117679ms target: https://us1.storj.io/login FAIL (2025-10-27 19:05:37 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 31.145697ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 31.431547ms target: https://us1.storj.io/login FAIL (2025-10-27 19:05:06 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 31.461201ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 40.450738ms target: https://us1.storj.io/login FAIL (2025-10-27 19:04:50 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 40.482941ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 33.048669ms target: https://us1.storj.io/login FAIL (2025-10-27 19:03:37 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 33.081974ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 34.787223ms target: https://us1.storj.io/login FAIL (2025-10-27 19:02:37 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 34.814973ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 31.843328ms target: https://us1.storj.io/login FAIL (2025-10-27 19:01:45 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 31.873149ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 32.892122ms target: https://us1.storj.io/login FAIL (2025-10-27 19:00:31 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 32.923457ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 32.764127ms target: https://us1.storj.io/login FAIL (2025-10-27 18:59:44 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 32.793085ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 29.223573ms target: https://us1.storj.io/login FAIL (2025-10-27 18:58:40 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 29.270627ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 35.407385ms target: https://us1.storj.io/login FAIL (2025-10-27 18:57:36 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 35.458442ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 35.692788ms target: https://us1.storj.io/login FAIL (2025-10-27 18:56:55 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 35.71478ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 35.158875ms target: https://us1.storj.io/login FAIL (2025-10-27 18:56:24 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 35.253055ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 31.681569ms target: https://us1.storj.io/login FAIL (2025-10-27 18:55:46 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 31.725737ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 42.259605ms target: https://us1.storj.io/login FAIL (2025-10-27 18:55:03 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 42.28946ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 33.570733ms target: https://us1.storj.io/login FAIL (2025-10-27 18:54:10 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 33.595818ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 31.054671ms target: https://us1.storj.io/login FAIL (2025-10-27 18:53:51 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 31.076249ms core satellite us1
checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 10.384689ms target: https://us1.storj.io/login FAIL (2025-10-27 18:52:56 UTC) orbiter warning: Get "https://us1.storj.io/login": dial tcp 35.212.10.183:443: connect: connection refused Duration: 10.469932ms core satellite us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 376.688025ms FAIL (2025-10-27 13:28:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 376.71738ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 375.581396ms FAIL (2025-10-27 13:27:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 375.612612ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 412.011398ms FAIL (2025-10-27 13:27:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 412.046576ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 422.542561ms FAIL (2025-10-27 13:25:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 422.628243ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 269.127978ms FAIL (2025-10-27 13:25:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 269.186646ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 247.646667ms FAIL (2025-10-27 13:25:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 247.6837ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [X...X.......................................................] duration: 377.307563ms FAIL (2025-10-27 13:24:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 377.3455ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [XX...X......................................................] duration: 404.679915ms FAIL (2025-10-27 13:24:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 404.711491ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 197.283751ms FAIL (2025-10-27 13:24:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 197.31304ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.XX...X.....................................................] duration: 399.955019ms FAIL (2025-10-27 13:23:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 399.998853ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 213.687468ms FAIL (2025-10-27 13:23:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 213.731242ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..XX...X....................................................] duration: 398.925848ms FAIL (2025-10-27 13:23:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 399.023793ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 246.498563ms FAIL (2025-10-27 13:23:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 246.532434ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 204.963342ms FAIL (2025-10-27 13:22:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 204.994692ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...XX...X...................................................] duration: 410.846932ms FAIL (2025-10-27 13:22:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 410.877322ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 196.328538ms FAIL (2025-10-27 13:21:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 196.374676ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....XX...X..................................................] duration: 351.697488ms FAIL (2025-10-27 13:21:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 351.780675ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....XX...X.................................................] duration: 412.607093ms FAIL (2025-10-27 13:21:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 412.643087ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 273.499446ms FAIL (2025-10-27 13:21:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 273.523096ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 196.89955ms FAIL (2025-10-27 13:20:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 196.979827ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......XX...X................................................] duration: 448.880174ms FAIL (2025-10-27 13:20:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 448.931879ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 210.794626ms FAIL (2025-10-27 13:19:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 210.836978ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......XX...X...............................................] duration: 458.5446ms FAIL (2025-10-27 13:19:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 458.591929ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........XX...X..............................................] duration: 429.337119ms FAIL (2025-10-27 13:19:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 429.370865ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 180.500464ms FAIL (2025-10-27 13:18:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 180.53318ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........XX...X.............................................] duration: 406.540674ms FAIL (2025-10-27 13:18:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 406.574126ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 209.119817ms FAIL (2025-10-27 13:18:01 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 209.152255ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 209.413344ms FAIL (2025-10-27 13:17:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 209.444663ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........XX...X............................................] duration: 511.616087ms FAIL (2025-10-27 13:17:03 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 511.633705ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 194.730849ms FAIL (2025-10-27 13:16:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:42:07.837922634 (733h23m53.748294507s) [upload=762189]: Starting upload Oct 27 12:42:07.838022900 (733h23m53.748394773s) [upload=762189]: Done starting upload Oct 27 12:42:07.838119945 (733h23m53.748491814s) [upload=762189]: Uploading segments... Oct 27 12:42:07.838198500 (733h23m53.74857038s) [upload=762189]: Got next segment. Inline: true Oct 27 12:42:07.838232452 (733h23m53.748604321s) [upload=762189]: Waiting for error group managing segments... Oct 27 12:42:07.838289422 (733h23m53.7486613s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:42:07.838312024 (733h23m53.748683893s) [upload=762189]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Oct 27 12:42:07.838316458 (733h23m53.748688327s) [upload=762189]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:43:07.797330135 (733h24m53.707702006s) [upload=762189]: Done uploading segments... Oct 27 12:43:07.797362585 (733h24m53.707734463s) [upload=762189]: Upload finished. err: metaclient: context deadline exceeded Duration:* 194.778972ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........XX...X...........................................] duration: 397.699809ms FAIL (2025-10-27 13:15:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== Oct 27 12:45:38.667404919 (733h27m24.577776776s) [upload=762248]: Starting upload Oct 27 12:45:38.667464159 (733h27m24.577836032s) [upload=762248]: Done starting upload Oct 27 12:45:38.667807593 (733h27m24.578179453s) [upload=762248]: Uploading segments... Oct 27 12:45:38.667874772 (733h27m24.57824664s) [upload=762248]: Got next segment. Inline: false Oct 27 12:45:38.667915143 (733h27m24.578287s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectBegin Oct 27 12:45:38.667922654 (733h27m24.578294522s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentBegin Oct 27 12:45:38.706331218 (733h27m24.616703092s) [seg_pos={0 0}, upload=762248]: Begin upload segment... Oct 27 12:45:38.706407791 (733h27m24.616779661s) [seg_pos={0 0}, upload=762248]: Done begin upload segment. Oct 27 12:45:38.706453462 (733h27m24.616825336s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706472018 (733h27m24.616843893s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706536403 (733h27m24.616908272s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706959467 (733h27m24.617331335s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.706981918 (733h27m24.61735379s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707474367 (733h27m24.617846244s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707523876 (733h27m24.617895746s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707904560 (733h27m24.618276428s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.707924689 (733h27m24.61829655s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708228407 (733h27m24.618600275s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708550551 (733h27m24.618922419s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.708859181 (733h27m24.61923105s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709390661 (733h27m24.619762533s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709543805 (733h27m24.619915673s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.709765947 (733h27m24.620137818s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710060610 (733h27m24.620432464s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710181440 (733h27m24.620553309s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.710793230 (733h27m24.621165101s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Uploading piece... Oct 27 12:45:38.783197983 (733h27m24.693569844s) [upload=762248]: Next returned nil segment Oct 27 12:45:38.783214763 (733h27m24.693586635s) [upload=762248]: Waiting for error group managing segments... Oct 27 12:45:38.787755505 (733h27m24.698127377s) [noise=true , address=45.91.116.6:4977 , piece_id=GDJUOLNXRGPC6PEMNYG6D76SKUZTLK5DSKXLY5RSJTKS4P7C6PSQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789173882 (733h27m24.699545742s) [noise=true , address=77.90.31.15:4706 , piece_id=OA5BDXNRX4RZRDT7SEDT76F3IW4G344VWUWA3ITIAP4PIDF75DTA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.789639188 (733h27m24.700011043s) [noise=true , address=145.79.227.2:4125 , piece_id=26FVAKMSXLSWOQHBM4X55OJTZRWPYUBIRXYUROFETS3UL3VCLCIQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.791988865 (733h27m24.702360727s) [noise=true , address=77.90.31.12:4610 , piece_id=D4YBSL2CCQQAFWQ6RQ4PIASQMRS6ETAMKPQ6HRR4PO3O6TXCWEYA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.797477828 (733h27m24.707849702s) [noise=true , address=77.90.31.14:4669 , piece_id=577LM2MZ3JYQO5FGVCXJJMHTN2SUTYXKKINJYRCNAKMTYKMCDIPQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.800309737 (733h27m24.710681598s) [noise=true , address=45.91.116.5:4301 , piece_id=GMWSXGZOESJ4P5L5JBJZKNRHVQ4OUGYWRPFRYQ4HZHPFGCEYOUWA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.801359604 (733h27m24.711731465s) [noise=true , address=145.79.227.46:4613 , piece_id=LI6DRYFIELUXXAZGCIUZBP5BNR4T7ITQQ5IFFK5OOOBIW33YPFNA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802468760 (733h27m24.712840622s) [noise=true , address=45.91.116.4:4948 , piece_id=6HGRJUJKHLUUU5IOYIVZUT74MMSQJMT4FJOTF3BLTAMJN62FS5BA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.802910032 (733h27m24.713281893s) [noise=true , address=45.91.116.8:4065 , piece_id=OUXWBNQGWQYGQCKMEDR435TPYDWCYHLBV5IT4CGFUCZSWN6FYA3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804479635 (733h27m24.714851493s) [noise=true , address=45.91.116.12:4247 , piece_id=CSZQ3RMYJEJCZMTJDYEJUZUYVK47EO7EUYOQOULNMXH7VUL6GJKQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.804931711 (733h27m24.715303569s) [noise=true , address=145.79.227.19:4099 , piece_id=XDB6WWFJ3GFRHZERYOCHHNSNODWKETP5FAM43GRRP6T6BHDIPNMA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806183322 (733h27m24.716555184s) [noise=true , address=77.90.31.16:4753 , piece_id=22DO6I6YEX2A5DRDBPYGSX4IIF3FMQRZKSR5CTQE5NQ3TQDYOCTQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.806467094 (733h27m24.716838964s) [noise=true , address=45.91.116.7:4023 , piece_id=UH7LYWBURRCV7OIMS34NTSHXP2XLN47GN3RHTULZ4T2ZAWWQUV3Q, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832791432 (733h27m24.743163302s) [noise=true , address=77.90.31.13:4629 , piece_id=RRPUZNWUT7B2UVTFB7WOHVUERP3SMMDSP4CCJDZOF45HISC4WYCA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.832825975 (733h27m24.743197844s) [seg_pos={0 0}, upload=762248]: Segment reached optimal threshold of 14 pieces. Oct 27 12:45:38.833044165 (733h27m24.743416025s) [noise=true , address=77.90.31.18:4830 , piece_id=O6GPFF3RBOFYKF6EW7NXJAAEVSAGBVYKAGKLNWWWXVKLZBR7OVKA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: <nil> Oct 27 12:45:38.833062873 (733h27m24.743434742s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833077136 (733h27m24.743449014s) [noise=true , address=77.90.31.21:4880 , piece_id=LQF6A7PEIY2R2WO7H2AULRTO5JYO7EKUWSBDO4CJ2M4SJ3NKF3AQ, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833182567 (733h27m24.743554424s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MwFhR5fkW2mNRpj7qAKGdRRC8ua2SBAppwWmyxYuhgpUkZETE): protocol: expected piece hash; context canceled; EOF Oct 27 12:45:38.833190367 (733h27m24.743562238s) [noise=true , address=77.90.31.10:4544 , piece_id=ANTAVDRNSXKTZIIQQ3HPHR66NVUKLHMDHNNNSIJXN4GK25QSDWIA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833417833 (733h27m24.743789703s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: read tcp 159.223.143.39:37978->64.49.13.170:4722: use of closed network connection; conn closed: op; piecestore: piecestore close: context canceled Oct 27 12:45:38.833433085 (733h27m24.743804964s) [noise=true , address=64.49.13.170:4722 , piece_id=ON6JXIWAAF2JHASFZMG22TEKENJDUHU7FMVFOLBA3FPQBDS6EHRA, seg_pos={0 0}, upload=762248]: Long tail cancellation due to optimal threshold Oct 27 12:45:38.833460377 (733h27m24.743832246s) [seg_pos={0 0}, upload=762248]: Done waiting for segment. successful: 15 optimal: 14 errs: <nil> Oct 27 12:45:38.833546717 (733h27m24.743918586s) [upload=762248]: Flush batch item: pb.BatchRequestItem_SegmentCommit Oct 27 12:45:38.833552788 (733h27m24.743924657s) [upload=762248]: Flush batch item: pb.BatchRequestItem_ObjectCommit Oct 27 12:46:38.652657858 (733h28m24.563029718s) [upload=762248]: Done uploading segments... Oct 27 12:46:38.652686704 (733h28m24.563058572s) [upload=762248]: Upload finished. err: metaclient: context deadline exceeded Duration: 397.730793ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.HTTP{"GET" "https://us1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.us1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)