Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X...................X.....] duration: 543.373105ms FAIL (2025-08-07 17:18:26 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== .BatchRequestItem_ObjectBegin Aug 7 17:14:05.445383605 (7h34m39.960486186s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:14:05.534779439 (7h34m40.049882018s) [seg_pos={0 0}, upload=7866]: Begin upload segment... Aug 7 17:14:05.534857801 (7h34m40.049960394s) [seg_pos={0 0}, upload=7866]: Done begin upload segment. Aug 7 17:14:05.534895203 (7h34m40.049997793s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534908646 (7h34m40.050011213s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534994375 (7h34m40.050096957s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535467307 (7h34m40.050569895s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535564340 (7h34m40.050666948s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535843313 (7h34m40.0509459s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536163752 (7h34m40.051266335s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536308887 (7h34m40.051411473s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536637925 (7h34m40.051740506s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536655240 (7h34m40.051757827s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536947657 (7h34m40.052050236s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537118188 (7h34m40.052220773s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537269378 (7h34m40.052371954s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537662702 (7h34m40.052765291s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.539440271 (7h34m40.05454285s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540326255 (7h34m40.055428841s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540862680 (7h34m40.055965262s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.542037241 (7h34m40.057139819s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.648934634 (7h34m40.164037219s) [upload=7866]: Next returned nil segment Aug 7 17:14:05.648953871 (7h34m40.164056457s) [upload=7866]: Waiting for error group managing segments... Aug 7 17:14:05.656881070 (7h34m40.171983636s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.661055993 (7h34m40.176158559s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.665139330 (7h34m40.180241896s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.673362182 (7h34m40.18846475s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674065570 (7h34m40.189168135s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674464549 (7h34m40.189567127s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674534531 (7h34m40.189637101s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.675321914 (7h34m40.190424485s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.678820294 (7h34m40.19392286s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.690917968 (7h34m40.206020546s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.693097507 (7h34m40.2082001s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697148924 (7h34m40.212251486s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697919267 (7h34m40.213021836s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818479195 (7h34m40.333581772s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818496748 (7h34m40.333599324s) [seg_pos={0 0}, upload=7866]: Segment reached optimal threshold of 14 pieces. Aug 7 17:14:05.818850686 (7h34m40.333953263s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection Aug 7 17:14:05.819198457 (7h34m40.334301035s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V6JKTP7zarv1WrXD7giosej1eFWCEhUkDok4xS7obfZy4ksbw): protocol: read tcp 159.223.143.39:40672->79.127.205.233:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819265015 (7h34m40.334367599s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1frFBZNqMLDUjojkdhrBU4GFXckd3kB2Seok1yXngUT7UyciBz): protocol: read tcp 159.223.143.39:53422->64.49.13.155:4920: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819306255 (7h34m40.334408832s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: read tcp 159.223.143.39:35222->64.49.13.26:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819330501 (7h34m40.334433065s) [seg_pos={0 0}, upload=7866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:14:05.819405469 (7h34m40.334508047s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:14:05.819411338 (7h34m40.334513918s) [upload=7866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:14:05.930048860 (7h34m40.445151445s) [upload=7866]: Done uploading segments... Aug 7 17:14:05.930069948 (7h34m40.445172531s) [upload=7866]: Upload finished. err: <nil> Duration:* 543.41029ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X...................X....] duration: 846.729893ms FAIL (2025-08-07 17:17:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== .BatchRequestItem_ObjectBegin Aug 7 17:14:05.445383605 (7h34m39.960486186s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:14:05.534779439 (7h34m40.049882018s) [seg_pos={0 0}, upload=7866]: Begin upload segment... Aug 7 17:14:05.534857801 (7h34m40.049960394s) [seg_pos={0 0}, upload=7866]: Done begin upload segment. Aug 7 17:14:05.534895203 (7h34m40.049997793s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534908646 (7h34m40.050011213s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534994375 (7h34m40.050096957s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535467307 (7h34m40.050569895s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535564340 (7h34m40.050666948s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535843313 (7h34m40.0509459s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536163752 (7h34m40.051266335s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536308887 (7h34m40.051411473s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536637925 (7h34m40.051740506s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536655240 (7h34m40.051757827s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536947657 (7h34m40.052050236s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537118188 (7h34m40.052220773s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537269378 (7h34m40.052371954s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537662702 (7h34m40.052765291s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.539440271 (7h34m40.05454285s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540326255 (7h34m40.055428841s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540862680 (7h34m40.055965262s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.542037241 (7h34m40.057139819s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.648934634 (7h34m40.164037219s) [upload=7866]: Next returned nil segment Aug 7 17:14:05.648953871 (7h34m40.164056457s) [upload=7866]: Waiting for error group managing segments... Aug 7 17:14:05.656881070 (7h34m40.171983636s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.661055993 (7h34m40.176158559s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.665139330 (7h34m40.180241896s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.673362182 (7h34m40.18846475s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674065570 (7h34m40.189168135s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674464549 (7h34m40.189567127s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674534531 (7h34m40.189637101s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.675321914 (7h34m40.190424485s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.678820294 (7h34m40.19392286s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.690917968 (7h34m40.206020546s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.693097507 (7h34m40.2082001s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697148924 (7h34m40.212251486s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697919267 (7h34m40.213021836s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818479195 (7h34m40.333581772s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818496748 (7h34m40.333599324s) [seg_pos={0 0}, upload=7866]: Segment reached optimal threshold of 14 pieces. Aug 7 17:14:05.818850686 (7h34m40.333953263s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection Aug 7 17:14:05.819198457 (7h34m40.334301035s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V6JKTP7zarv1WrXD7giosej1eFWCEhUkDok4xS7obfZy4ksbw): protocol: read tcp 159.223.143.39:40672->79.127.205.233:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819265015 (7h34m40.334367599s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1frFBZNqMLDUjojkdhrBU4GFXckd3kB2Seok1yXngUT7UyciBz): protocol: read tcp 159.223.143.39:53422->64.49.13.155:4920: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819306255 (7h34m40.334408832s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: read tcp 159.223.143.39:35222->64.49.13.26:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819330501 (7h34m40.334433065s) [seg_pos={0 0}, upload=7866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:14:05.819405469 (7h34m40.334508047s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:14:05.819411338 (7h34m40.334513918s) [upload=7866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:14:05.930048860 (7h34m40.445151445s) [upload=7866]: Done uploading segments... Aug 7 17:14:05.930069948 (7h34m40.445172531s) [upload=7866]: Upload finished. err: <nil> Duration:* 846.755125ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X...................X...] duration: 609.556822ms FAIL (2025-08-07 17:16:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== .BatchRequestItem_ObjectBegin Aug 7 17:14:05.445383605 (7h34m39.960486186s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:14:05.534779439 (7h34m40.049882018s) [seg_pos={0 0}, upload=7866]: Begin upload segment... Aug 7 17:14:05.534857801 (7h34m40.049960394s) [seg_pos={0 0}, upload=7866]: Done begin upload segment. Aug 7 17:14:05.534895203 (7h34m40.049997793s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534908646 (7h34m40.050011213s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534994375 (7h34m40.050096957s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535467307 (7h34m40.050569895s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535564340 (7h34m40.050666948s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535843313 (7h34m40.0509459s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536163752 (7h34m40.051266335s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536308887 (7h34m40.051411473s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536637925 (7h34m40.051740506s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536655240 (7h34m40.051757827s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536947657 (7h34m40.052050236s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537118188 (7h34m40.052220773s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537269378 (7h34m40.052371954s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537662702 (7h34m40.052765291s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.539440271 (7h34m40.05454285s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540326255 (7h34m40.055428841s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540862680 (7h34m40.055965262s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.542037241 (7h34m40.057139819s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.648934634 (7h34m40.164037219s) [upload=7866]: Next returned nil segment Aug 7 17:14:05.648953871 (7h34m40.164056457s) [upload=7866]: Waiting for error group managing segments... Aug 7 17:14:05.656881070 (7h34m40.171983636s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.661055993 (7h34m40.176158559s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.665139330 (7h34m40.180241896s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.673362182 (7h34m40.18846475s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674065570 (7h34m40.189168135s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674464549 (7h34m40.189567127s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674534531 (7h34m40.189637101s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.675321914 (7h34m40.190424485s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.678820294 (7h34m40.19392286s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.690917968 (7h34m40.206020546s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.693097507 (7h34m40.2082001s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697148924 (7h34m40.212251486s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697919267 (7h34m40.213021836s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818479195 (7h34m40.333581772s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818496748 (7h34m40.333599324s) [seg_pos={0 0}, upload=7866]: Segment reached optimal threshold of 14 pieces. Aug 7 17:14:05.818850686 (7h34m40.333953263s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection Aug 7 17:14:05.819198457 (7h34m40.334301035s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V6JKTP7zarv1WrXD7giosej1eFWCEhUkDok4xS7obfZy4ksbw): protocol: read tcp 159.223.143.39:40672->79.127.205.233:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819265015 (7h34m40.334367599s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1frFBZNqMLDUjojkdhrBU4GFXckd3kB2Seok1yXngUT7UyciBz): protocol: read tcp 159.223.143.39:53422->64.49.13.155:4920: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819306255 (7h34m40.334408832s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: read tcp 159.223.143.39:35222->64.49.13.26:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819330501 (7h34m40.334433065s) [seg_pos={0 0}, upload=7866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:14:05.819405469 (7h34m40.334508047s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:14:05.819411338 (7h34m40.334513918s) [upload=7866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:14:05.930048860 (7h34m40.445151445s) [upload=7866]: Done uploading segments... Aug 7 17:14:05.930069948 (7h34m40.445172531s) [upload=7866]: Upload finished. err: <nil> Duration:* 609.579911ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X...................X..] duration: 599.655691ms FAIL (2025-08-07 17:15:47 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== .BatchRequestItem_ObjectBegin Aug 7 17:14:05.445383605 (7h34m39.960486186s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:14:05.534779439 (7h34m40.049882018s) [seg_pos={0 0}, upload=7866]: Begin upload segment... Aug 7 17:14:05.534857801 (7h34m40.049960394s) [seg_pos={0 0}, upload=7866]: Done begin upload segment. Aug 7 17:14:05.534895203 (7h34m40.049997793s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534908646 (7h34m40.050011213s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534994375 (7h34m40.050096957s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535467307 (7h34m40.050569895s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535564340 (7h34m40.050666948s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535843313 (7h34m40.0509459s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536163752 (7h34m40.051266335s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536308887 (7h34m40.051411473s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536637925 (7h34m40.051740506s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536655240 (7h34m40.051757827s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536947657 (7h34m40.052050236s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537118188 (7h34m40.052220773s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537269378 (7h34m40.052371954s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537662702 (7h34m40.052765291s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.539440271 (7h34m40.05454285s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540326255 (7h34m40.055428841s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540862680 (7h34m40.055965262s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.542037241 (7h34m40.057139819s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.648934634 (7h34m40.164037219s) [upload=7866]: Next returned nil segment Aug 7 17:14:05.648953871 (7h34m40.164056457s) [upload=7866]: Waiting for error group managing segments... Aug 7 17:14:05.656881070 (7h34m40.171983636s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.661055993 (7h34m40.176158559s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.665139330 (7h34m40.180241896s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.673362182 (7h34m40.18846475s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674065570 (7h34m40.189168135s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674464549 (7h34m40.189567127s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674534531 (7h34m40.189637101s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.675321914 (7h34m40.190424485s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.678820294 (7h34m40.19392286s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.690917968 (7h34m40.206020546s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.693097507 (7h34m40.2082001s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697148924 (7h34m40.212251486s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697919267 (7h34m40.213021836s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818479195 (7h34m40.333581772s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818496748 (7h34m40.333599324s) [seg_pos={0 0}, upload=7866]: Segment reached optimal threshold of 14 pieces. Aug 7 17:14:05.818850686 (7h34m40.333953263s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection Aug 7 17:14:05.819198457 (7h34m40.334301035s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V6JKTP7zarv1WrXD7giosej1eFWCEhUkDok4xS7obfZy4ksbw): protocol: read tcp 159.223.143.39:40672->79.127.205.233:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819265015 (7h34m40.334367599s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1frFBZNqMLDUjojkdhrBU4GFXckd3kB2Seok1yXngUT7UyciBz): protocol: read tcp 159.223.143.39:53422->64.49.13.155:4920: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819306255 (7h34m40.334408832s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: read tcp 159.223.143.39:35222->64.49.13.26:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819330501 (7h34m40.334433065s) [seg_pos={0 0}, upload=7866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:14:05.819405469 (7h34m40.334508047s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:14:05.819411338 (7h34m40.334513918s) [upload=7866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:14:05.930048860 (7h34m40.445151445s) [upload=7866]: Done uploading segments... Aug 7 17:14:05.930069948 (7h34m40.445172531s) [upload=7866]: Upload finished. err: <nil> Duration:* 599.688118ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X...................X.] duration: 723.345877ms FAIL (2025-08-07 17:15:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== .BatchRequestItem_ObjectBegin Aug 7 17:14:05.445383605 (7h34m39.960486186s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:14:05.534779439 (7h34m40.049882018s) [seg_pos={0 0}, upload=7866]: Begin upload segment... Aug 7 17:14:05.534857801 (7h34m40.049960394s) [seg_pos={0 0}, upload=7866]: Done begin upload segment. Aug 7 17:14:05.534895203 (7h34m40.049997793s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534908646 (7h34m40.050011213s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534994375 (7h34m40.050096957s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535467307 (7h34m40.050569895s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535564340 (7h34m40.050666948s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535843313 (7h34m40.0509459s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536163752 (7h34m40.051266335s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536308887 (7h34m40.051411473s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536637925 (7h34m40.051740506s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536655240 (7h34m40.051757827s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536947657 (7h34m40.052050236s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537118188 (7h34m40.052220773s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537269378 (7h34m40.052371954s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537662702 (7h34m40.052765291s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.539440271 (7h34m40.05454285s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540326255 (7h34m40.055428841s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540862680 (7h34m40.055965262s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.542037241 (7h34m40.057139819s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.648934634 (7h34m40.164037219s) [upload=7866]: Next returned nil segment Aug 7 17:14:05.648953871 (7h34m40.164056457s) [upload=7866]: Waiting for error group managing segments... Aug 7 17:14:05.656881070 (7h34m40.171983636s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.661055993 (7h34m40.176158559s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.665139330 (7h34m40.180241896s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.673362182 (7h34m40.18846475s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674065570 (7h34m40.189168135s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674464549 (7h34m40.189567127s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674534531 (7h34m40.189637101s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.675321914 (7h34m40.190424485s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.678820294 (7h34m40.19392286s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.690917968 (7h34m40.206020546s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.693097507 (7h34m40.2082001s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697148924 (7h34m40.212251486s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697919267 (7h34m40.213021836s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818479195 (7h34m40.333581772s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818496748 (7h34m40.333599324s) [seg_pos={0 0}, upload=7866]: Segment reached optimal threshold of 14 pieces. Aug 7 17:14:05.818850686 (7h34m40.333953263s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection Aug 7 17:14:05.819198457 (7h34m40.334301035s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V6JKTP7zarv1WrXD7giosej1eFWCEhUkDok4xS7obfZy4ksbw): protocol: read tcp 159.223.143.39:40672->79.127.205.233:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819265015 (7h34m40.334367599s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1frFBZNqMLDUjojkdhrBU4GFXckd3kB2Seok1yXngUT7UyciBz): protocol: read tcp 159.223.143.39:53422->64.49.13.155:4920: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819306255 (7h34m40.334408832s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: read tcp 159.223.143.39:35222->64.49.13.26:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819330501 (7h34m40.334433065s) [seg_pos={0 0}, upload=7866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:14:05.819405469 (7h34m40.334508047s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:14:05.819411338 (7h34m40.334513918s) [upload=7866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:14:05.930048860 (7h34m40.445151445s) [upload=7866]: Done uploading segments... Aug 7 17:14:05.930069948 (7h34m40.445172531s) [upload=7866]: Upload finished. err: <nil> Duration:* 723.373858ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X...................X] duration: 630.47002ms FAIL (2025-08-07 17:14:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== .BatchRequestItem_ObjectBegin Aug 7 17:14:05.445383605 (7h34m39.960486186s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 17:14:05.534779439 (7h34m40.049882018s) [seg_pos={0 0}, upload=7866]: Begin upload segment... Aug 7 17:14:05.534857801 (7h34m40.049960394s) [seg_pos={0 0}, upload=7866]: Done begin upload segment. Aug 7 17:14:05.534895203 (7h34m40.049997793s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534908646 (7h34m40.050011213s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.534994375 (7h34m40.050096957s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535467307 (7h34m40.050569895s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535564340 (7h34m40.050666948s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.535843313 (7h34m40.0509459s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536163752 (7h34m40.051266335s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536308887 (7h34m40.051411473s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536637925 (7h34m40.051740506s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536655240 (7h34m40.051757827s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.536947657 (7h34m40.052050236s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537118188 (7h34m40.052220773s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537269378 (7h34m40.052371954s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.537662702 (7h34m40.052765291s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.539440271 (7h34m40.05454285s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540326255 (7h34m40.055428841s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.540862680 (7h34m40.055965262s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.542037241 (7h34m40.057139819s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Uploading piece... Aug 7 17:14:05.648934634 (7h34m40.164037219s) [upload=7866]: Next returned nil segment Aug 7 17:14:05.648953871 (7h34m40.164056457s) [upload=7866]: Waiting for error group managing segments... Aug 7 17:14:05.656881070 (7h34m40.171983636s) [noise=true , address=104.36.82.55:4194 , piece_id=YM3I2HNCDATQGUFN5NSHKT6OOBQQG3YQCKXJJ2ZAWW3KDQRQLRJA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.661055993 (7h34m40.176158559s) [noise=true , address=104.36.82.39:4759 , piece_id=42A2R3LCI3C7Q25XWBZ532DZBFEKKHKCSO4CJS73AB6ZR5U7QMOA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.665139330 (7h34m40.180241896s) [noise=true , address=45.91.116.13:4184 , piece_id=EQKTKDL4DIYMBVIIOZWKBBYPKLJODUZTCK6R4WVNJI3B5GG5XDQA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.673362182 (7h34m40.18846475s) [noise=true , address=45.91.116.8:4054 , piece_id=VNVXAXAWHVT3RWYOBBJYQA6FA346IWVO2VELQBGIMP6YLBT2IGZA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674065570 (7h34m40.189168135s) [noise=true , address=104.36.82.53:4136 , piece_id=QRFIY2UJEIYW3264RFEBUSMHQGTW5RIQO7XGWCZUC3ZERW35AFVA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674464549 (7h34m40.189567127s) [noise=true , address=104.36.82.46:4493 , piece_id=IILK6KWT3DDEPEPTSFW743JRMUWEZD7MITKEDRXUYBC5XWA6ODNA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.674534531 (7h34m40.189637101s) [noise=true , address=104.36.82.9:4017 , piece_id=MCBUBFETS3QI64UWWXBBF3OOZEUUNJF5USMEERLV5DMJBQMXI6OA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.675321914 (7h34m40.190424485s) [noise=true , address=104.36.82.43:4848 , piece_id=5WAO2INQLCOUMQZCF5PDN65ZWGMNAXCVXBO3BOY7IHOBZWJ3L47Q, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.678820294 (7h34m40.19392286s) [noise=true , address=104.36.82.60:4368 , piece_id=L6WGEZ4XTAJVZ6U4ADMRDHJN4TZHXN4W6TJWAXIP6HOPWYH5RJAA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.690917968 (7h34m40.206020546s) [noise=true , address=104.36.82.5:4870 , piece_id=S4QTI7S2ZAH7L5QRIPIMFW3I6SJV7GQNNEHMCC7B6DN27UYDOMDA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.693097507 (7h34m40.2082001s) [noise=true , address=104.36.82.17:4332 , piece_id=3BCE6NUYSFGKMUJ42RANWJJXLOFPA7EAVYAKH2PRLGQVS2MJMKRA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697148924 (7h34m40.212251486s) [noise=true , address=104.36.82.10:4103 , piece_id=IFABLPQQB24R3LDY3RJY3WQNYOVYOXLXEDUPOJ6U3QK4WFYTCVMA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.697919267 (7h34m40.213021836s) [noise=true , address=104.36.82.58:4274 , piece_id=JTNNIQ2ZTS644NFSYIZFXWGOWBJD3QREVI4NZMOJIM7HW7GWATIA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818479195 (7h34m40.333581772s) [noise=true , address=104.36.82.16:4319 , piece_id=K2CST26EBN4C3K5L7GZWETTCRWZCYOHIGH72OIAATONVHNOTVBWQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: <nil> Aug 7 17:14:05.818496748 (7h34m40.333599324s) [seg_pos={0 0}, upload=7866]: Segment reached optimal threshold of 14 pieces. Aug 7 17:14:05.818850686 (7h34m40.333953263s) [noise=true , address=104.36.82.59:4308 , piece_id=GSTWR56AKN5YQ2ECWYQUUC5TE6NDU2XST4SUWZ65TUJW3VN7ZNXA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Tf9N11h9nLjVCMDpqacHE4qT6NYoPAGWLPbkLX14TZPp8dUV9): protocol: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:36616->104.36.82.59:4308: use of closed network connection Aug 7 17:14:05.819198457 (7h34m40.334301035s) [noise=true , address=79.127.205.233:4632 , piece_id=QGJ4X6S47F7QHUJHCEFONI5QOVK4TEXMRNPRMVGWVDGFD5O4GXAQ, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V6JKTP7zarv1WrXD7giosej1eFWCEhUkDok4xS7obfZy4ksbw): protocol: read tcp 159.223.143.39:40672->79.127.205.233:4632: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819265015 (7h34m40.334367599s) [noise=true , address=64.49.13.155:4920 , piece_id=U2AHNYZQU2OAJZ7JFR7HDDP4DKSE5MZNDQKW627PJ56T37WB3E4A, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1frFBZNqMLDUjojkdhrBU4GFXckd3kB2Seok1yXngUT7UyciBz): protocol: read tcp 159.223.143.39:53422->64.49.13.155:4920: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819306255 (7h34m40.334408832s) [noise=true , address=64.49.13.26:4952 , piece_id=SO7LPGTIPPKUV6ZTQIRX6H2UP3I365P6HMAO5HGFOS33HOEPAXEA, seg_pos={0 0}, upload=7866]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1okyMVGQotKJf1ysn8KeBxsmQJoR1amH1kLtYpgYGnADRcK5C8): protocol: read tcp 159.223.143.39:35222->64.49.13.26:4952: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 17:14:05.819330501 (7h34m40.334433065s) [seg_pos={0 0}, upload=7866]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 17:14:05.819405469 (7h34m40.334508047s) [upload=7866]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 17:14:05.819411338 (7h34m40.334513918s) [upload=7866]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 17:14:05.930048860 (7h34m40.445151445s) [upload=7866]: Done uploading segments... Aug 7 17:14:05.930069948 (7h34m40.445172531s) [upload=7866]: Upload finished. err: <nil> Duration:* 630.578415ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 444.497821ms FAIL (2025-08-07 17:12:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 444.525227ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 644.082901ms FAIL (2025-08-07 17:12:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 644.109984ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 451.350983ms FAIL (2025-08-07 17:12:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 451.374123ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 649.179147ms FAIL (2025-08-07 17:11:55 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 649.204607ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 558.462716ms FAIL (2025-08-07 17:11:33 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 558.486514ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 678.042901ms FAIL (2025-08-07 17:10:35 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 678.06978ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 600.70981ms FAIL (2025-08-07 17:09:29 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 600.737388ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 492.150597ms FAIL (2025-08-07 17:09:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 492.196168ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 564.253596ms FAIL (2025-08-07 17:08:11 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 564.28307ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 770.039738ms FAIL (2025-08-07 17:07:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 770.081829ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 979.224071ms FAIL (2025-08-07 17:06:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 979.257915ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 528.740005ms FAIL (2025-08-07 17:05:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 528.76753ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 551.674686ms FAIL (2025-08-07 17:05:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 551.766747ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 196.301427ms FAIL (2025-08-07 17:05:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 196.500195ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 193.505753ms FAIL (2025-08-07 17:04:07 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 193.536032ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 555.514042ms FAIL (2025-08-07 17:04:05 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 555.543903ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 495.047157ms FAIL (2025-08-07 17:03:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 495.083296ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 679.301239ms FAIL (2025-08-07 17:03:14 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 679.326238ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 407.112669ms FAIL (2025-08-07 17:02:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 407.140386ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.282500276s FAIL (2025-08-07 17:02:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 1.282525281s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 298.154946ms FAIL (2025-08-07 17:01:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 298.272669ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 590.377247ms FAIL (2025-08-07 17:00:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 590.45474ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 205.885384ms FAIL (2025-08-07 17:00:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 205.909492ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 540.727116ms FAIL (2025-08-07 17:00:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 540.819547ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 637.025306ms FAIL (2025-08-07 16:59:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 637.08489ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 194.174322ms FAIL (2025-08-07 16:59:53 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 194.209988ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 732.034ms FAIL (2025-08-07 16:58:59 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 732.05865ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 442.582708ms FAIL (2025-08-07 16:58:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 442.606604ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 430.544194ms FAIL (2025-08-07 16:58:17 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 430.568329ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 41.470255ms FAIL (2025-08-07 16:58:02 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== 6 (7h18m3.636229485s) [seg_pos={0 0}, upload=7582]: Done begin upload segment. Aug 7 16:57:29.121168379 (7h18m3.636270968s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121717901 (7h18m3.636820484s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.121778948 (7h18m3.63688153s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122504654 (7h18m3.637607231s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122685924 (7h18m3.6377885s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.122850216 (7h18m3.637952795s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123372570 (7h18m3.638475147s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.123600655 (7h18m3.638703236s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124044888 (7h18m3.639147466s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124361090 (7h18m3.639463666s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124849605 (7h18m3.63995218s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.124996553 (7h18m3.640099133s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125552840 (7h18m3.640655416s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.125837735 (7h18m3.640940311s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.127806523 (7h18m3.642909093s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.130345301 (7h18m3.645447879s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.131174270 (7h18m3.646276839s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.133338980 (7h18m3.648441556s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Uploading piece... Aug 7 16:57:29.204554341 (7h18m3.71965691s) [upload=7582]: Next returned nil segment Aug 7 16:57:29.204569068 (7h18m3.719671646s) [upload=7582]: Waiting for error group managing segments... Aug 7 16:57:29.217957403 (7h18m3.733059969s) [noise=true , address=45.91.116.9:4267 , piece_id=FUAQZQBLTIJ6522OENBGCY7ZZREHWAF6GANTOYYZBDDQZJZMKI7A, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.220799000 (7h18m3.73590159s) [noise=true , address=104.36.82.35:4616 , piece_id=J3VPZSBTU3IWN7FKLHZ5RG27VBD5GQSGGRAI2DTZOEXJ6OD3ZEGQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.224397024 (7h18m3.739499591s) [noise=true , address=45.91.116.8:4074 , piece_id=LR4ZTPHL457NMPDLKO3XYGR6G5D7OYKVVLLEDFXVNXEIMZPOUA3Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.225090475 (7h18m3.740193058s) [noise=true , address=104.36.82.37:4682 , piece_id=XIFBQIDGWGHKLC4VQ46LUW4GTXKELXL2P2KBL2DFB44PM5ISVR2Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.226388842 (7h18m3.741491408s) [noise=true , address=104.36.82.22:4525 , piece_id=RZRX2S27BGO5DGUPYDTAMWFRIPTAE2LNVCERXK32J7HT247VXHNA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.230869313 (7h18m3.745971883s) [noise=true , address=104.36.82.60:4349 , piece_id=GVOGYX4EGEF7LA5WVSOCGKW35O73RG2JSX22S6ZZTNAIP6MOZ3YQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.238042787 (7h18m3.753145356s) [noise=true , address=104.36.82.44:4903 , piece_id=KD3SN7LSTOFPD724345XPGBWPUVYH6PL4NX6OV2SXWMDYGNGXV5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.241733348 (7h18m3.756835924s) [noise=true , address=104.36.82.62:4438 , piece_id=NYEC5VETWXEOMTAPXZLGUUAJXDILRWEG2PMDOX47YV4LZU5RZZOA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.242264894 (7h18m3.757367461s) [noise=true , address=104.36.82.53:4148 , piece_id=FBVRYPA4RJGMRO5R7WMMQENRDAWY7LZUAM4LRUEE7Y44K6Z6UZMA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.246564958 (7h18m3.761667527s) [noise=true , address=104.36.82.13:4199 , piece_id=K4UZPOW3YAWNMGOXPGQDX2WKY4P3GIDWJ5K2XWF2JNYBVM3YOFAQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.247117133 (7h18m3.7622197s) [noise=true , address=104.36.82.5:4849 , piece_id=MHTELUVA5SZX2YEQWXEWID37NWZGNGONKF32BFXJTSCMZTHT4HPA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.251908819 (7h18m3.767011396s) [noise=true , address=104.36.82.58:4272 , piece_id=AZ4GDPDCQTU2UNRX6XWSIKSXIC6BXW6QX54N4XIAZJHC5ORZHL5Q, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.255428957 (7h18m3.770531533s) [noise=true , address=104.36.82.21:4492 , piece_id=FKZIPOMMXYPBHBKERBF6FPTZFKRKH2FBZNR3BGTIXZ5RNYQO3HKA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265117965 (7h18m3.780220547s) [noise=true , address=104.36.82.14:4236 , piece_id=OJ3FQWSXRCEGM5LXD5LKTNHIPJBVHMVCYSV3YDURXHV7G4FUCPIQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: <nil> Aug 7 16:57:29.265163495 (7h18m3.780266078s) [seg_pos={0 0}, upload=7582]: Segment reached optimal threshold of 14 pieces. Aug 7 16:57:29.265399871 (7h18m3.780502434s) [noise=true , address=104.36.82.16:4319 , piece_id=E3TYODKKRBRAVXC7E4P3J3E46W6O5D52IL2KAP6QO2Z2XEJCLDZA, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hQTG2DzecaoN1Na2mY3JJqNj2qxtJDQkhMYmRmd9hve8D7T9C): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265508228 (7h18m3.780610797s) [noise=true , address=104.36.82.61:4389 , piece_id=WJK5OFBQZYBNLJOPK5PTSULLH3UXHK4USVYJO5YHY27AJZA5VPBQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VbbhJD2Dga9GactoTgUPgDaKMq9p7YLKxjPtRhgkVbH4DKzpZ): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265522858 (7h18m3.780625423s) [noise=true , address=104.36.82.46:4496 , piece_id=7BCTDHZ75UB53Z5UDV3XTCVVXIW6EAJMRDGDLBXQ4KG6A66IZ3TQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12V8XhSWkyGUVYFR8MykifFAP1YAfGCwzqucDcMMfzw3xsVW77Z): protocol: expected piece hash; context canceled; EOF Aug 7 16:57:29.265630892 (7h18m3.780733456s) [noise=true , address=64.49.13.138:4481 , piece_id=JH6I5GQV7ZVBFGGFKIGAIHL5KGJ5Q2WSAGA7HY474GAGCJRRPFVQ, seg_pos={0 0}, upload=7582]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:16SmJMbycEDFbqMUkmhZ5bPJHdcehG16mQdgN4s6fHZ7VcshPT): protocol: context canceled; context canceled Aug 7 16:57:29.265652908 (7h18m3.780755478s) [seg_pos={0 0}, upload=7582]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 16:57:29.265771490 (7h18m3.780874081s) [upload=7582]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 16:57:29.265777895 (7h18m3.780880482s) [upload=7582]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:57:29.427431911 (7h18m3.942534496s) [upload=7582]: Done uploading segments... Aug 7 16:57:29.427454412 (7h18m3.94255698s) [upload=7582]: Upload finished. err: <nil> Aug 7 16:58:02.238378452 (7h18m36.753481035s) [upload=7592]: Starting upload Aug 7 16:58:02.238479737 (7h18m36.753582319s) [upload=7592]: Done starting upload Aug 7 16:58:02.238585243 (7h18m36.753687806s) [upload=7592]: Uploading segments... Aug 7 16:58:02.238974023 (7h18m36.754076611s) [upload=7592]: Got next segment. Inline: false Aug 7 16:58:02.239090284 (7h18m36.754192865s) [upload=7592]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:58:02.239097159 (7h18m36.754199738s) [upload=7592]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 16:58:02.247532646 (7h18m36.762635227s) [upload=7592]: Next segment err: metaclient: Too Many Requests Aug 7 16:58:02.247566701 (7h18m36.762669281s) [upload=7592]: Done uploading segments... Aug 7 16:58:02.247588306 (7h18m36.762690892s) [upload=7592]: Upload finished. err: metaclient: Too Many Requests Duration: 41.55913ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 207.08855ms FAIL (2025-08-07 16:57:42 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 207.143274ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 818.464025ms FAIL (2025-08-07 16:56:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 818.490246ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 367.517857ms FAIL (2025-08-07 16:56:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 367.567509ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 230.524408ms FAIL (2025-08-07 16:55:59 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 230.552009ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 1.017585067s FAIL (2025-08-07 16:55:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 1.017619894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 386.143317ms FAIL (2025-08-07 16:54:21 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 386.173506ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 221.973393ms FAIL (2025-08-07 16:53:16 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 222.007374ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 240.796428ms FAIL (2025-08-07 16:52:11 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 241.767583ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 274.170724ms FAIL (2025-08-07 16:51:24 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 274.201948ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 566.052182ms FAIL (2025-08-07 16:50:57 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 566.075574ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 195.44733ms FAIL (2025-08-07 16:49:55 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 195.471265ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 228.006604ms FAIL (2025-08-07 16:48:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 228.03354ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 823.49289ms FAIL (2025-08-07 16:48:15 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 823.545395ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 418.164327ms FAIL (2025-08-07 16:47:08 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/1K") ======LOGS====== .BatchRequestItem_SegmentMakeInline Aug 7 16:14:37.338017268 (6h35m11.853119836s) [upload=6836]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:14:37.416813653 (6h35m11.931916229s) [upload=6836]: Done uploading segments... Aug 7 16:14:37.416829775 (6h35m11.931932351s) [upload=6836]: Upload finished. err: <nil> Aug 7 16:15:34.134378027 (6h36m8.649480607s) [upload=6848]: Starting upload Aug 7 16:15:34.134442188 (6h36m8.649544768s) [upload=6848]: Done starting upload Aug 7 16:15:34.134523187 (6h36m8.649625755s) [upload=6848]: Uploading segments... Aug 7 16:15:34.134623930 (6h36m8.649726499s) [upload=6848]: Got next segment. Inline: true Aug 7 16:15:34.134628989 (6h36m8.649731565s) [upload=6848]: Waiting for error group managing segments... Aug 7 16:15:34.134682993 (6h36m8.649785558s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:15:34.134687746 (6h36m8.649790314s) [upload=6848]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:15:34.134692772 (6h36m8.649795348s) [upload=6848]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:15:34.305866365 (6h36m8.820968942s) [upload=6848]: Done uploading segments... Aug 7 16:15:34.305886497 (6h36m8.820989064s) [upload=6848]: Upload finished. err: <nil> Aug 7 16:16:12.393820650 (6h36m46.90892323s) [upload=6863]: Starting upload Aug 7 16:16:12.393899984 (6h36m46.909002562s) [upload=6863]: Done starting upload Aug 7 16:16:12.393995720 (6h36m46.909098294s) [upload=6863]: Uploading segments... Aug 7 16:16:12.394054515 (6h36m46.909157094s) [upload=6863]: Got next segment. Inline: true Aug 7 16:16:12.394059865 (6h36m46.909162442s) [upload=6863]: Waiting for error group managing segments... Aug 7 16:16:12.394104625 (6h36m46.909207202s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:12.394121482 (6h36m46.909224058s) [upload=6863]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:12.394125294 (6h36m46.90922787s) [upload=6863]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:12.532183345 (6h36m47.04728591s) [upload=6863]: Done uploading segments... Aug 7 16:16:12.532204941 (6h36m47.047307508s) [upload=6863]: Upload finished. err: <nil> Aug 7 16:16:55.398659651 (6h37m29.913762217s) [upload=6873]: Starting upload Aug 7 16:16:55.398719158 (6h37m29.913821723s) [upload=6873]: Done starting upload Aug 7 16:16:55.398786536 (6h37m29.913889104s) [upload=6873]: Uploading segments... Aug 7 16:16:55.398839508 (6h37m29.913942093s) [upload=6873]: Got next segment. Inline: true Aug 7 16:16:55.398844634 (6h37m29.913947211s) [upload=6873]: Waiting for error group managing segments... Aug 7 16:16:55.398908530 (6h37m29.91401111s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:16:55.398914668 (6h37m29.914017251s) [upload=6873]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:16:55.398919014 (6h37m29.914021602s) [upload=6873]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:16:55.641338783 (6h37m30.156441362s) [upload=6873]: Done uploading segments... Aug 7 16:16:55.641359338 (6h37m30.156461909s) [upload=6873]: Upload finished. err: <nil> Aug 7 16:17:21.777250616 (6h37m56.2923532s) [upload=6884]: Starting upload Aug 7 16:17:21.777322360 (6h37m56.292424923s) [upload=6884]: Done starting upload Aug 7 16:17:21.777391680 (6h37m56.29249426s) [upload=6884]: Uploading segments... Aug 7 16:17:21.777472449 (6h37m56.292575035s) [upload=6884]: Got next segment. Inline: true Aug 7 16:17:21.777479176 (6h37m56.292581755s) [upload=6884]: Waiting for error group managing segments... Aug 7 16:17:21.777556722 (6h37m56.292659309s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:21.777563989 (6h37m56.292666577s) [upload=6884]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:21.777568825 (6h37m56.292671402s) [upload=6884]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:21.860562528 (6h37m56.375665112s) [upload=6884]: Done uploading segments... Aug 7 16:17:21.860585009 (6h37m56.375687585s) [upload=6884]: Upload finished. err: <nil> Aug 7 16:17:59.427698777 (6h38m33.942801364s) [upload=6893]: Starting upload Aug 7 16:17:59.427781873 (6h38m33.942884449s) [upload=6893]: Done starting upload Aug 7 16:17:59.427871948 (6h38m33.942974511s) [upload=6893]: Uploading segments... Aug 7 16:17:59.427934472 (6h38m33.943037066s) [upload=6893]: Got next segment. Inline: true Aug 7 16:17:59.427941801 (6h38m33.943044382s) [upload=6893]: Waiting for error group managing segments... Aug 7 16:17:59.428005217 (6h38m33.9431078s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:17:59.428011350 (6h38m33.943113931s) [upload=6893]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:17:59.428014905 (6h38m33.94311747s) [upload=6893]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:17:59.732649851 (6h38m34.247752437s) [upload=6893]: Done uploading segments... Aug 7 16:17:59.732671988 (6h38m34.247774565s) [upload=6893]: Upload finished. err: <nil> Aug 7 16:18:58.246200487 (6h39m32.761303066s) [upload=6910]: Starting upload Aug 7 16:18:58.246257427 (6h39m32.761360007s) [upload=6910]: Done starting upload Aug 7 16:18:58.246336294 (6h39m32.761438862s) [upload=6910]: Uploading segments... Aug 7 16:18:58.246393294 (6h39m32.761495879s) [upload=6910]: Got next segment. Inline: true Aug 7 16:18:58.246398340 (6h39m32.761500905s) [upload=6910]: Waiting for error group managing segments... Aug 7 16:18:58.246440293 (6h39m32.761542859s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:18:58.246456680 (6h39m32.761559256s) [upload=6910]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:18:58.246460285 (6h39m32.76156286s) [upload=6910]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:18:58.362100950 (6h39m32.877203529s) [upload=6910]: Done uploading segments... Aug 7 16:18:58.362123467 (6h39m32.877226034s) [upload=6910]: Upload finished. err: <nil> Aug 7 16:19:50.419303403 (6h40m24.93440597s) [upload=6923]: Starting upload Aug 7 16:19:50.419371336 (6h40m24.934473912s) [upload=6923]: Done starting upload Aug 7 16:19:50.419499061 (6h40m24.934601643s) [upload=6923]: Uploading segments... Aug 7 16:19:50.419606528 (6h40m24.934709105s) [upload=6923]: Got next segment. Inline: true Aug 7 16:19:50.419614815 (6h40m24.934717393s) [upload=6923]: Waiting for error group managing segments... Aug 7 16:19:50.419669467 (6h40m24.93477203s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:19:50.419675875 (6h40m24.934778452s) [upload=6923]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:19:50.419680868 (6h40m24.934783455s) [upload=6923]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:19:50.558974249 (6h40m25.074076826s) [upload=6923]: Done uploading segments... Aug 7 16:19:50.559007513 (6h40m25.07411009s) [upload=6923]: Upload finished. err: <nil> Aug 7 16:20:16.065571707 (6h40m50.580674294s) [upload=6933]: Starting upload Aug 7 16:20:16.065649506 (6h40m50.580752075s) [upload=6933]: Done starting upload Aug 7 16:20:16.065722674 (6h40m50.580825241s) [upload=6933]: Uploading segments... Aug 7 16:20:16.065785025 (6h40m50.580887605s) [upload=6933]: Got next segment. Inline: true Aug 7 16:20:16.065789962 (6h40m50.58089253s) [upload=6933]: Waiting for error group managing segments... Aug 7 16:20:16.065850215 (6h40m50.580952777s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:16.065855943 (6h40m50.580958506s) [upload=6933]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:16.065859156 (6h40m50.580961718s) [upload=6933]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:16.331318946 (6h40m50.846421522s) [upload=6933]: Done uploading segments... Aug 7 16:20:16.331349191 (6h40m50.846451756s) [upload=6933]: Upload finished. err: <nil> Aug 7 16:20:55.182506292 (6h41m29.697608871s) [upload=6943]: Starting upload Aug 7 16:20:55.182634328 (6h41m29.697736905s) [upload=6943]: Done starting upload Aug 7 16:20:55.182759974 (6h41m29.697862545s) [upload=6943]: Uploading segments... Aug 7 16:20:55.182844310 (6h41m29.697946889s) [upload=6943]: Got next segment. Inline: true Aug 7 16:20:55.182852887 (6h41m29.697955466s) [upload=6943]: Waiting for error group managing segments... Aug 7 16:20:55.182902519 (6h41m29.698005095s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:20:55.182907446 (6h41m29.698010022s) [upload=6943]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:20:55.182911034 (6h41m29.69801361s) [upload=6943]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:20:55.430315133 (6h41m29.945417702s) [upload=6943]: Done uploading segments... Aug 7 16:20:55.430333757 (6h41m29.945436324s) [upload=6943]: Upload finished. err: <nil> Aug 7 16:22:01.288035274 (6h42m35.80313785s) [upload=6959]: Starting upload Aug 7 16:22:01.288107918 (6h42m35.803210499s) [upload=6959]: Done starting upload Aug 7 16:22:01.288192409 (6h42m35.80329499s) [upload=6959]: Uploading segments... Aug 7 16:22:01.288241648 (6h42m35.803344235s) [upload=6959]: Got next segment. Inline: true Aug 7 16:22:01.288247795 (6h42m35.803350362s) [upload=6959]: Waiting for error group managing segments... Aug 7 16:22:01.288297460 (6h42m35.803400026s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 16:22:01.288303823 (6h42m35.803406389s) [upload=6959]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 16:22:01.288309086 (6h42m35.80341166s) [upload=6959]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 16:22:02.311667093 (6h42m36.826769677s) [upload=6959]: Done uploading segments... Aug 7 16:22:02.311693256 (6h42m36.826795837s) [upload=6959]: Upload finished. err: <nil> Duration:* 418.219174ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)