Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 533.630936ms FAIL (2025-07-24 16:21:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 533.687784ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X..........................X................] duration: 186.860945ms FAIL (2025-07-24 16:20:45 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 186.888252ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X..........................X...............] duration: 364.090389ms FAIL (2025-07-24 16:20:07 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 364.117851ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 487.897759ms FAIL (2025-07-24 16:19:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 487.933679ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X..........................X..............] duration: 250.33496ms FAIL (2025-07-24 16:19:12 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 250.362346ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 503.293734ms FAIL (2025-07-24 16:18:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 503.331408ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 472.438425ms FAIL (2025-07-24 16:18:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 472.467206ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X..........................X.............] duration: 209.899892ms FAIL (2025-07-24 16:18:12 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 209.944461ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X..........................X............] duration: 187.511668ms FAIL (2025-07-24 16:17:39 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 187.54658ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 511.577049ms FAIL (2025-07-24 16:17:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 511.606808ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X..........................X...........] duration: 383.309052ms FAIL (2025-07-24 16:17:18 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 383.335178ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 546.447119ms FAIL (2025-07-24 16:16:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 546.487554ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X..........................X..........] duration: 291.924756ms FAIL (2025-07-24 16:16:22 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 291.981773ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 533.060063ms FAIL (2025-07-24 16:15:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 533.095526ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................X..........................X.........] duration: 234.666763ms FAIL (2025-07-24 16:15:25 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 234.698912ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................X..........................X........] duration: 228.203432ms FAIL (2025-07-24 16:15:04 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 228.237742ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 529.400286ms FAIL (2025-07-24 16:14:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 529.422675ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 430.830401ms FAIL (2025-07-24 16:14:20 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 430.864149ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................X..........................X.......] duration: 216.279735ms FAIL (2025-07-24 16:14:11 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 216.310952ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 453.808596ms FAIL (2025-07-24 16:13:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 453.838517ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................X..........................X......] duration: 217.525993ms FAIL (2025-07-24 16:13:22 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 217.571296ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 496.078045ms FAIL (2025-07-24 16:13:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 496.111216ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 563.258866ms FAIL (2025-07-24 16:12:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 563.297301ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 489.385807ms FAIL (2025-07-24 16:12:25 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 489.498053ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...........................X..........................X.....] duration: 214.783356ms FAIL (2025-07-24 16:12:14 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 214.828013ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 493.982543ms FAIL (2025-07-24 16:12:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 494.030798ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 446.846533ms FAIL (2025-07-24 16:11:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 446.882124ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............................X..........................X....] duration: 204.838062ms FAIL (2025-07-24 16:11:16 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 204.866332ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............................X..........................X...] duration: 196.499352ms FAIL (2025-07-24 16:10:56 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 196.527674ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 465.798427ms FAIL (2025-07-24 16:10:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 465.831084ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............................X..........................X..] duration: 292.677766ms FAIL (2025-07-24 16:10:31 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 292.708087ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 493.111392ms FAIL (2025-07-24 16:10:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 493.146085ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 578.807471ms FAIL (2025-07-24 16:09:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 578.846933ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............................X..........................X.] duration: 197.148162ms FAIL (2025-07-24 16:09:24 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 197.174215ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................................X..........................X] duration: 1.18383947s FAIL (2025-07-24 16:08:42 UTC) orbiter warning: unable to find key in bucket: sj://uplink/orbiter_us_0/1K Duration: 1.183864539s core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 512.777356ms FAIL (2025-07-24 16:08:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 512.804556ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 208.843555ms FAIL (2025-07-24 16:07:34 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 208.867998ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 486.938914ms FAIL (2025-07-24 16:07:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 486.980906ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 517.450623ms FAIL (2025-07-24 16:06:42 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 517.480806ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 389.877036ms FAIL (2025-07-24 16:06:14 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 389.906048ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 726.495288ms FAIL (2025-07-24 16:06:03 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 726.565753ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [X...................................X.......................] duration: 261.377513ms FAIL (2025-07-24 16:05:43 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 261.433016ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.X...................................X......................] duration: 250.71747ms FAIL (2025-07-24 16:05:26 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 250.754285ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 470.639201ms FAIL (2025-07-24 16:04:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 470.673526ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 518.833923ms FAIL (2025-07-24 16:04:33 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 518.869167ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..X...................................X.....................] duration: 260.285172ms FAIL (2025-07-24 16:04:30 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 260.315679ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 479.651133ms FAIL (2025-07-24 16:03:58 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 479.738519ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 459.795792ms FAIL (2025-07-24 16:03:29 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 459.872287ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...X...................................X....................] duration: 290.818774ms FAIL (2025-07-24 16:03:16 UTC) orbiter warning: uplink: invalid range 0:1024 (size:1024) Duration: 290.846869ms core uplink us1 vivint
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 539.906255ms FAIL (2025-07-24 16:03:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 4 15:49:32.773378263 (4h14m15.618179791s) [noise=true , address=104.36.82.2:4731 , piece_id=RHRW7DOC7XVA4KC42AXSEVPOO7EXWZMCFQ5RAERD2QQORFXPG7CA, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1m6CiDtKdTVJSdeLWBbGZh6LS66pnTP8YoVwFpKSccTKoJfok9): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.773493318 (4h14m15.618294842s) [noise=true , address=77.90.31.17:4770 , piece_id=DO2XQURJGOXEEOBW3IBW33W3ZIUHBPAFYZYRJQE3LQEKYXDEWY4A, seg_pos={0 0}, upload=4078]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:32.774928430 (4h14m15.619729963s) [seg_pos={0 0}, upload=4078]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 24 15:49:32.775085353 (4h14m15.619886885s) [upload=4078]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:32.775093900 (4h14m15.619895432s) [upload=4078]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:32.835756543 (4h14m15.680558077s) [upload=4078]: Done uploading segments... Jul 24 15:49:32.835781734 (4h14m15.680583265s) [upload=4078]: Upload finished. err: <nil> Jul 24 15:49:52.822405551 (4h14m35.667207374s) [upload=4084]: Starting upload Jul 24 15:49:52.822493739 (4h14m35.667295263s) [upload=4084]: Done starting upload Jul 24 15:49:52.822599158 (4h14m35.667400671s) [upload=4084]: Uploading segments... Jul 24 15:49:52.822959891 (4h14m35.667761501s) [upload=4084]: Got next segment. Inline: false Jul 24 15:49:52.823099325 (4h14m35.667900853s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 24 15:49:52.823111114 (4h14m35.667912653s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 24 15:49:52.850910509 (4h14m35.695712038s) [seg_pos={0 0}, upload=4084]: Begin upload segment... Jul 24 15:49:52.850965269 (4h14m35.695766791s) [seg_pos={0 0}, upload=4084]: Done begin upload segment. Jul 24 15:49:52.850990183 (4h14m35.695791711s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851214143 (4h14m35.696015658s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.851554375 (4h14m35.696355891s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.854055990 (4h14m35.698857507s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855100879 (4h14m35.699902395s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.855748871 (4h14m35.70055039s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857414366 (4h14m35.702215881s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.857915020 (4h14m35.702716528s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.858570240 (4h14m35.703371749s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.861604249 (4h14m35.706405764s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.866740961 (4h14m35.711542479s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.869985347 (4h14m35.714786863s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.876776057 (4h14m35.721577581s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.883528933 (4h14m35.728330445s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.885234973 (4h14m35.730036494s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.887059653 (4h14m35.731861179s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Uploading piece... Jul 24 15:49:52.964166448 (4h14m35.808967957s) [upload=4084]: Next returned nil segment Jul 24 15:49:52.964183578 (4h14m35.808985086s) [upload=4084]: Waiting for error group managing segments... Jul 24 15:49:52.968754443 (4h14m35.813555958s) [noise=true , address=45.91.116.7:4011 , piece_id=VHOQKRFYTEZHUGBW7XR2IYZ37GBIBR5ZPJOTNTVJVVBRVKCKM6LQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.969466297 (4h14m35.814267806s) [noise=true , address=45.91.116.13:4155 , piece_id=LTH3H4552JRWK5KIB4JQUP2RQVOJWMZD2SB3I4TZ5RGXPUDUDU2A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.970339045 (4h14m35.815140571s) [noise=true , address=45.91.116.14:4191 , piece_id=RFJ4RXZO5JGLPELWZGCWJ4VR2D64YM7A3QPMV77OQC6NL4NZS43A, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971167465 (4h14m35.815968991s) [noise=true , address=45.91.116.10:4083 , piece_id=5BDP45CYKZHQ2Y47U7RRDHZJSJH4QSBWSBFJJVCFRIS7WY2ACZCA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.971957821 (4h14m35.816759332s) [noise=true , address=77.90.31.11:4555 , piece_id=6R27XKSDHRT5ZD5K4YJV35ARFR2Q6OT7OX3UH3LASABEP3BCFJCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.972521197 (4h14m35.817322706s) [noise=true , address=77.90.31.14:4663 , piece_id=PBBDQLYUN7BXLV4SWIHPUOIZWRMSGSJUBE5YG7ESIPSV23ILZB5Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973080847 (4h14m35.817882356s) [noise=true , address=77.90.31.18:4805 , piece_id=VFTFXW2D5C5HOGMN3HDO3YV64NKY35QMW2SQFJZUFAIHZKQU5GDA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.973557157 (4h14m35.81835867s) [noise=true , address=77.90.31.13:4627 , piece_id=PSA2QX6V4ZUT6VT53JOD4NZZJNHQ4O4ZSSWHKIHXZI46BWQFPGFQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974040084 (4h14m35.8188416s) [noise=true , address=45.91.116.11:4119 , piece_id=TQAICC5MBEGZU2ZNSN5KS4WVYLFBEPKG2XIEAQZWHTHKS7GHSY7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.974630169 (4h14m35.819431692s) [noise=true , address=45.91.116.9:4262 , piece_id=3A6OLSPOU4L6CJN3LWOYBEFZXICIT4K2DTFD36GUKOKE6BNGOBHA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975385438 (4h14m35.82018695s) [noise=true , address=77.90.31.15:4699 , piece_id=CWKGJDXXWI5CNRHQM6YSJWW24JUGBYXBOQXQKI6OZUCCMMUYNHCQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975626637 (4h14m35.820428149s) [noise=true , address=104.36.82.16:4295 , piece_id=A2CHZP2YVLQZVAQZIEOFKCJCK4RCFZNT6DPKYK5BHORPPKFJUNAQ, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.975998688 (4h14m35.820800201s) [noise=true , address=45.91.116.12:4225 , piece_id=NDYKU4W2XS7IDO67Z2PGLQ7XDYORSUYBTV3HPRH3MZDPBD7YM3WA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976013334 (4h14m35.820814849s) [seg_pos={0 0}, upload=4084]: Segment reached optimal threshold of 13 pieces. Jul 24 15:49:52.976086775 (4h14m35.820888286s) [noise=true , address=77.90.31.16:4735 , piece_id=MAEO4CXKNN5UBLU4M4YE5N4FJHHEDCDRNN24VHNQJBFPL42H7X7Q, seg_pos={0 0}, upload=4084]: Done uploading piece. err: <nil> Jul 24 15:49:52.976248458 (4h14m35.82104998s) [noise=true , address=104.36.82.5:4840 , piece_id=7JV5DRJDSVC3ZLN76UMDFCKUEEBZPBPSJCQPYPS6NBEBPW6R3VAA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Jul 24 15:49:52.976283573 (4h14m35.821085098s) [noise=true , address=104.36.82.10:4079 , piece_id=Y5JN6XT4IF4AC6I45MFRFEHM4CWHX7NPN2NXM7GT4X2ZS5QM54XA, seg_pos={0 0}, upload=4084]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XgHpMHksVDkRiDokvccpMMCNXfvH29SBPspkNrLcZuPE2fdud): protocol: context canceled; context canceled Jul 24 15:49:52.976299609 (4h14m35.821101134s) [seg_pos={0 0}, upload=4084]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 24 15:49:52.976451534 (4h14m35.821253068s) [upload=4084]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 24 15:49:52.976458390 (4h14m35.821259919s) [upload=4084]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 24 15:49:53.491987364 (4h14m36.336788893s) [upload=4084]: Done uploading segments... Jul 24 15:49:53.492001500 (4h14m36.336803023s) [upload=4084]: Upload finished. err: <nil> Duration: 539.935357ms core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uplink", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)