Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 426.411518ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:57:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 426.44389ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 571.447526ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:57:31 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 571.46476ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 399.160213ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:56:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 399.197561ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 509.789856ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:55:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 509.828112ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 421.026578ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:54:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 421.054613ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 476.296752ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:53:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 476.32036ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 569.949052ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:52:35 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 570.02778ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 451.603713ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:51:29 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 451.629133ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 405.780565ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:50:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 405.80344ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 428.731776ms trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:49:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 428.759558ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.033256878s trace: https://jaeger.dev.storj.io/trace/60013b57840b8670 FAIL (2025-12-21 14:49:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 21 14:48:35.208910548 (383h20m36.036618945s) [upload=398891]: Starting upload Dec 21 14:48:35.208965530 (383h20m36.036673931s) [upload=398891]: Done starting upload Dec 21 14:48:35.209225644 (383h20m36.036934035s) [upload=398891]: Uploading segments... Dec 21 14:48:35.209267032 (383h20m36.036975429s) [upload=398891]: Got next segment. Inline: false Dec 21 14:48:35.209298408 (383h20m36.037006802s) [upload=398891]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 21 14:48:35.209303116 (383h20m36.037011507s) [upload=398891]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 21 14:48:35.246827936 (383h20m36.074536327s) [seg_pos={0 0}, upload=398891]: Begin upload segment... Dec 21 14:48:35.246877959 (383h20m36.07458635s) [seg_pos={0 0}, upload=398891]: Done begin upload segment. Dec 21 14:48:35.246911319 (383h20m36.07461972s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247218213 (383h20m36.074926616s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.247970233 (383h20m36.075678627s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248493316 (383h20m36.07620171s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248639760 (383h20m36.076348162s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.248914690 (383h20m36.076623081s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249310412 (383h20m36.077018805s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249362388 (383h20m36.077070786s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249713170 (383h20m36.077421561s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.249995699 (383h20m36.077704101s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250100446 (383h20m36.077808838s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250512045 (383h20m36.07822044s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250557413 (383h20m36.078265815s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.250860348 (383h20m36.078568741s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251217843 (383h20m36.078926248s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.251866331 (383h20m36.079574734s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Uploading piece... Dec 21 14:48:35.309661017 (383h20m36.137369398s) [upload=398891]: Next returned nil segment Dec 21 14:48:35.309673439 (383h20m36.137381821s) [upload=398891]: Waiting for error group managing segments... Dec 21 14:48:35.319714746 (383h20m36.147423137s) [noise=true , address=145.79.227.49:4338 , piece_id=5CUS5TMAV2HENROSH3N5JRS2EL2GDQLHHKBYBJHR2ZBQIOJRH6LA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.320180766 (383h20m36.147889157s) [noise=true , address=145.79.227.27:4690 , piece_id=XWSZU6T5LLH6MFJBAHZTVBPHSF73J3H2BWJMAZBFTV6U66U6MFQA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.323625111 (383h20m36.151333503s) [noise=true , address=145.79.227.36:4517 , piece_id=JVRU3RUDTM6OW2O5YC6L7CEN6KHE2VAYZAWWFBTFA7RKSY5AI46Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324433197 (383h20m36.152141589s) [noise=true , address=145.79.227.50:4373 , piece_id=6C2F3J5RTI2UDMW2FQ2CZSG26JLAFGF6BCFVEDGLVCS5ZJPEMNWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324849789 (383h20m36.152558182s) [noise=true , address=145.79.227.45:4230 , piece_id=ZRODQSPZZRJUQTXJ7W7NCQPMS3WHGSEGCE57MO745QRLAODTPL6A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.324917589 (383h20m36.15262598s) [noise=true , address=45.91.116.8:4046 , piece_id=HTU63D6RE6IUYFVOBBTXC2UQQFIZMFZZKPXWLQT5VJV3SWJUUNOQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.325357173 (383h20m36.153065567s) [noise=true , address=145.79.227.38:4978 , piece_id=63SFM77QWCYIQB55LWAV3L7PZLZ6WPSFIVGKKINRRYLCXZ6OXHUA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.326179304 (383h20m36.153887695s) [noise=true , address=145.79.227.48:4302 , piece_id=VKUG23TADUHL2M3TJARK2HRRH3MTIAGGSCXDPELHOSXXNGCEN6JQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.334132619 (383h20m36.161841011s) [noise=true , address=45.91.116.10:4081 , piece_id=MVXPEY4IO4UMPU3CTBLGT7R7EX3JTHGT4NA55R67Z6LZ7O2Q2NWQ, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.338292172 (383h20m36.166000563s) [noise=true , address=45.91.116.12:4227 , piece_id=NRA6HLLT3POBMULHMR2DHB35FGEJAEZNQXOQPKPPGNIPHJUEP5GA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:35.375591835 (383h20m36.203300228s) [noise=true , address=77.90.31.10:4520 , piece_id=KFGGQAJVLP67X52MOBCG7KPLGL6N5GKVZ4KCWYK52WDGRC6KHJSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:48:37.850982304 (383h20m38.678690695s) [noise=true , address=145.79.227.39:4014 , piece_id=RNMLJBJ66X6FWCDXQWDLFSRPOVI6N6RMXEICE7FCYILLIETP6Z2Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: <nil> Dec 21 14:49:05.172572805 (383h21m6.000281206s) [noise=true , address=145.79.227.42:4121 , piece_id=X3JVYQLT4JLZQWIIB7RJX3LRDGTHE3KNO6PIMEPW24OWFOYBHGSA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1QJBWV6xLXS7DcX8d26be79z1DH3r27oi4EcuiwVwR5Dn8JEGh, address:145.79.227.42:4121): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172616657 (383h21m6.000325081s) [noise=true , address=145.79.227.32:4836 , piece_id=3L5SD7OZENYQOIAE7BDWFGGVN2TZGNNNJK6ZG6U5BLFBSUKTY27Q, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:1jic2LawZWwB7J3oFbhRSM2YMurEqQQJM8UEEwWj25h3PxMugR, address:145.79.227.32:4836): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172750719 (383h21m6.000459119s) [noise=true , address=145.79.227.10:4402 , piece_id=EKN65OKLPMDNU37Y4CSKPZ5MSDQD47EECI7YFA63Z63N3XWNGH4A, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12CMKNUtKvidnZpTfnYPxDCPUdvaSUs5mAx9oFFd2bWfuocTT4u, address:145.79.227.10:4402): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172900971 (383h21m6.000609365s) [noise=true , address=45.91.116.4:4940 , piece_id=5AI4QVZRF6EHIW6CCPFNNRYNDP6KX3ZT7X62YCZRQY7AXYXZ4WIA, seg_pos={0 0}, upload=398891]: Done uploading piece. err: ecclient: upload failed (node:12ifieiAT4XHJHsEsrwSqqnRmctV79VUkoWwq3aCQjxWqK8MiCe, address:45.91.116.4:4940): protocol: expected piece hash; context deadline exceeded; EOF Dec 21 14:49:05.172932795 (383h21m6.000641187s) [seg_pos={0 0}, upload=398891]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 21 14:49:05.203212563 (383h21m6.030920954s) [upload=398891]: Done uploading segments... Dec 21 14:49:05.203251269 (383h21m6.03095966s) [upload=398891]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.033279535s core uplink us-select-1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 271.054215ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:39:53 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 271.07883ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 275.859798ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:39:25 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 275.883968ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 292.988761ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:39:06 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 293.012938ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 270.93537ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:38:28 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 270.962005ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 274.159237ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:37:41 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 274.186769ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 272.204545ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:36:40 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 272.297732ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 266.913541ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:35:57 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 266.938219ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 274.074793ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:35:37 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 274.10337ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 271.06648ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:34:43 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 271.093245ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 258.496692ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:34:08 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 258.523134ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 771.281118ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:33:34 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 771.300727ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 269.493232ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:32:56 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 269.523596ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 270.967822ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:32:22 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 270.990625ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 288.043783ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:31:46 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 288.073075ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 271.862611ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:30:36 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 271.878369ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 280.151942ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:29:58 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 280.174144ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 300.213617ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:29:17 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 300.471624ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 775.910312ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:28:06 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 775.942482ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 289.792862ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:27:47 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 289.832841ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 280.939082ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:27:26 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 280.970786ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 270.606655ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:26:36 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 270.628409ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 275.292601ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:25:26 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 275.318333ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......................X.....................................] duration: 792.663786ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:24:13 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 792.690239ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.......................X....................................] duration: 274.439292ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:23:24 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 274.456639ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [........................X...................................] duration: 278.827336ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:22:57 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 278.857361ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.........................X..................................] duration: 740.842436ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:22:01 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 740.876394ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..........................X.................................] duration: 270.183082ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:20:48 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 270.261042ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...........................X................................] duration: 773.912486ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:20:20 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 773.93414ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [............................X...............................] duration: 278.58753ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:19:37 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 278.611617ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.............................X..............................] duration: 268.329753ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:19:11 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 268.365132ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..............................X.............................] duration: 269.858249ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:18:01 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 269.883913ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...............................X............................] duration: 297.394712ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:17:16 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 297.42004ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [................................X...........................] duration: 772.851888ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:16:39 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 772.873871ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.................................X..........................] duration: 261.084972ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:16:03 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 261.172913ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [..................................X.........................] duration: 292.223532ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:15:47 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 292.248477ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [...................................X........................] duration: 268.82002ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:14:48 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 268.847873ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [....................................X.......................] duration: 280.451919ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:13:38 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 280.472958ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [.....................................X......................] duration: 270.523521ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:12:29 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 270.54479ms edge linksharing bgp ap1
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing) antiblip: 1 out of 60 is failed (threshold=6) [......................................X.....................] duration: 291.222938ms remote: "tcp:136.0.77.4:443" target: https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt trace: https://jaeger.dev.storj.io/trace/b43219c4af15e80 FAIL (2025-12-21 01:11:59 UTC) orbiter warning: Get "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt": context deadline exceeded Duration: 291.250902ms edge linksharing bgp ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)

checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwlk53gfhsby563unjoqoivp56jq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.ap1.linksharing)