Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 4 out of 60 is failed (threshold=3) [.......................................................X.XXX] duration: 30.000868034s FAIL (2025-08-07 21:17:19 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== <nil> Aug 7 21:09:09.556774580 (11h29m44.071877161s) [upload=11956]: Starting upload Aug 7 21:09:09.556869520 (11h29m44.071972101s) [upload=11956]: Done starting upload Aug 7 21:09:09.556938280 (11h29m44.072040846s) [upload=11956]: Uploading segments... Aug 7 21:09:09.557010711 (11h29m44.072113296s) [upload=11956]: Got next segment. Inline: true Aug 7 21:09:09.557016786 (11h29m44.072119352s) [upload=11956]: Waiting for error group managing segments... Aug 7 21:09:09.557085460 (11h29m44.072188039s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:09.557091284 (11h29m44.07219386s) [upload=11956]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:09.557094925 (11h29m44.072197502s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:09.747686849 (11h29m44.262789432s) [upload=11956]: Done uploading segments... Aug 7 21:09:09.747707829 (11h29m44.262810399s) [upload=11956]: Upload finished. err: <nil> Aug 7 21:09:59.461356278 (11h30m33.976458859s) [upload=11970]: Starting upload Aug 7 21:09:59.461514228 (11h30m33.976616814s) [upload=11970]: Done starting upload Aug 7 21:09:59.461657967 (11h30m33.976760542s) [upload=11970]: Uploading segments... Aug 7 21:09:59.461728003 (11h30m33.976830589s) [upload=11970]: Got next segment. Inline: true Aug 7 21:09:59.461733779 (11h30m33.976836356s) [upload=11970]: Waiting for error group managing segments... Aug 7 21:09:59.461777635 (11h30m33.976880202s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:59.461783114 (11h30m33.97688569s) [upload=11970]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:59.461787951 (11h30m33.976890529s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:59.731460482 (11h30m34.246563058s) [upload=11970]: Done uploading segments... Aug 7 21:09:59.731478076 (11h30m34.246580652s) [upload=11970]: Upload finished. err: <nil> Aug 7 21:10:42.945656363 (11h31m17.460758936s) [upload=11982]: Starting upload Aug 7 21:10:42.945741284 (11h31m17.460843863s) [upload=11982]: Done starting upload Aug 7 21:10:42.945850852 (11h31m17.46095342s) [upload=11982]: Uploading segments... Aug 7 21:10:42.945892389 (11h31m17.460994975s) [upload=11982]: Got next segment. Inline: true Aug 7 21:10:42.945897243 (11h31m17.460999819s) [upload=11982]: Waiting for error group managing segments... Aug 7 21:10:42.945957561 (11h31m17.461060137s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:42.945962699 (11h31m17.461065276s) [upload=11982]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:42.945965846 (11h31m17.461068421s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:43.061691785 (11h31m17.576794373s) [upload=11982]: Done uploading segments... Aug 7 21:10:43.061710851 (11h31m17.576813425s) [upload=11982]: Upload finished. err: <nil> Aug 7 21:11:55.646673634 (11h32m30.161776203s) [upload=12003]: Starting upload Aug 7 21:11:55.646725223 (11h32m30.161827806s) [upload=12003]: Done starting upload Aug 7 21:11:55.646793999 (11h32m30.161896566s) [upload=12003]: Uploading segments... Aug 7 21:11:55.646853254 (11h32m30.161955836s) [upload=12003]: Got next segment. Inline: true Aug 7 21:11:55.646858259 (11h32m30.161960835s) [upload=12003]: Waiting for error group managing segments... Aug 7 21:11:55.646908687 (11h32m30.162011263s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:55.646914002 (11h32m30.162016583s) [upload=12003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:55.646918834 (11h32m30.162021413s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:55.718218370 (11h32m30.233320937s) [upload=12003]: Done uploading segments... Aug 7 21:11:55.718234789 (11h32m30.233337359s) [upload=12003]: Upload finished. err: <nil> Aug 7 21:12:27.468174562 (11h33m1.983277139s) [upload=12010]: Starting upload Aug 7 21:12:27.468269218 (11h33m1.983371788s) [upload=12010]: Done starting upload Aug 7 21:12:27.468432459 (11h33m1.983535027s) [upload=12010]: Uploading segments... Aug 7 21:12:27.468502812 (11h33m1.983605391s) [upload=12010]: Got next segment. Inline: true Aug 7 21:12:27.468509793 (11h33m1.983612369s) [upload=12010]: Waiting for error group managing segments... Aug 7 21:12:27.468577961 (11h33m1.983680537s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:27.468583494 (11h33m1.98368607s) [upload=12010]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:27.468587033 (11h33m1.983689609s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:27.713163795 (11h33m2.228266382s) [upload=12010]: Done uploading segments... Aug 7 21:12:27.713184263 (11h33m2.228286844s) [upload=12010]: Upload finished. err: <nil> Aug 7 21:13:00.260488755 (11h33m34.775591337s) [upload=12021]: Starting upload Aug 7 21:13:00.260589735 (11h33m34.775692306s) [upload=12021]: Done starting upload Aug 7 21:13:00.260688806 (11h33m34.775791377s) [upload=12021]: Uploading segments... Aug 7 21:13:00.260755956 (11h33m34.775858537s) [upload=12021]: Got next segment. Inline: true Aug 7 21:13:00.260760943 (11h33m34.775863519s) [upload=12021]: Waiting for error group managing segments... Aug 7 21:13:00.260825909 (11h33m34.775928474s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:00.260831124 (11h33m34.775933703s) [upload=12021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:00.260834322 (11h33m34.7759369s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:30.231998317 (11h34m4.747100894s) [upload=12021]: Done uploading segments... Aug 7 21:13:30.232017085 (11h34m4.74711966s) [upload=12021]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:13:34.490529998 (11h34m9.005632564s) [upload=12029]: Starting upload Aug 7 21:13:34.490599665 (11h34m9.005702244s) [upload=12029]: Done starting upload Aug 7 21:13:34.490712022 (11h34m9.005814599s) [upload=12029]: Uploading segments... Aug 7 21:13:34.490822609 (11h34m9.005925188s) [upload=12029]: Got next segment. Inline: true Aug 7 21:13:34.490828860 (11h34m9.005931437s) [upload=12029]: Waiting for error group managing segments... Aug 7 21:13:34.490903638 (11h34m9.006006215s) [upload=12029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:34.490908813 (11h34m9.006011379s) [upload=12029]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:34.490911892 (11h34m9.00601446s) [upload=12029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:34.880488092 (11h34m9.39559068s) [upload=12029]: Done uploading segments... Aug 7 21:13:34.880508926 (11h34m9.395611515s) [upload=12029]: Upload finished. err: <nil> Aug 7 21:14:45.394850433 (11h35m19.909953011s) [upload=12049]: Starting upload Aug 7 21:14:45.394946608 (11h35m19.910049187s) [upload=12049]: Done starting upload Aug 7 21:14:45.395065277 (11h35m19.910167846s) [upload=12049]: Uploading segments... Aug 7 21:14:45.395104752 (11h35m19.910207337s) [upload=12049]: Got next segment. Inline: true Aug 7 21:14:45.395110169 (11h35m19.910212745s) [upload=12049]: Waiting for error group managing segments... Aug 7 21:14:45.395152641 (11h35m19.910255207s) [upload=12049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:45.395157021 (11h35m19.910259598s) [upload=12049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:14:45.395161401 (11h35m19.910263982s) [upload=12049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:15:15.359522906 (11h35m49.874625488s) [upload=12049]: Done uploading segments... Aug 7 21:15:15.359549039 (11h35m49.874651622s) [upload=12049]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:15:53.553631580 (11h36m28.068734159s) [upload=12066]: Starting upload Aug 7 21:15:53.553693025 (11h36m28.068795593s) [upload=12066]: Done starting upload Aug 7 21:15:53.553757062 (11h36m28.06885963s) [upload=12066]: Uploading segments... Aug 7 21:15:53.553809335 (11h36m28.068911922s) [upload=12066]: Got next segment. Inline: true Aug 7 21:15:53.553813895 (11h36m28.068916471s) [upload=12066]: Waiting for error group managing segments... Aug 7 21:15:53.553863687 (11h36m28.068966263s) [upload=12066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:15:53.553867873 (11h36m28.068970453s) [upload=12066]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:15:53.553871084 (11h36m28.068973661s) [upload=12066]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:16:23.520202496 (11h36m58.035305071s) [upload=12066]: Done uploading segments... Aug 7 21:16:23.520223689 (11h36m58.035326265s) [upload=12066]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:16:49.902511179 (11h37m24.417613746s) [upload=12081]: Starting upload Aug 7 21:16:49.902589681 (11h37m24.417692258s) [upload=12081]: Done starting upload Aug 7 21:16:49.902694562 (11h37m24.41779713s) [upload=12081]: Uploading segments... Aug 7 21:16:49.902734709 (11h37m24.417837294s) [upload=12081]: Got next segment. Inline: true Aug 7 21:16:49.902739795 (11h37m24.417842425s) [upload=12081]: Waiting for error group managing segments... Aug 7 21:16:49.902793344 (11h37m24.41789592s) [upload=12081]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:16:49.902798176 (11h37m24.417900742s) [upload=12081]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:16:49.902801774 (11h37m24.417904341s) [upload=12081]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:17:19.864701484 (11h37m54.379804061s) [upload=12081]: Done uploading segments... Aug 7 21:17:19.864724958 (11h37m54.379827534s) [upload=12081]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.000888806s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.001080562s FAIL (2025-08-07 21:17:05 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878707848 (11h32m24.393810434s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879171370 (11h32m24.39427396s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879563499 (11h32m24.394666085s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879928199 (11h32m24.395030797s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.974975266 (11h32m24.490077832s) [upload=11997]: Next returned nil segment Aug 7 21:11:49.974994144 (11h32m24.49009672s) [upload=11997]: Waiting for error group managing segments... Aug 7 21:11:49.988542190 (11h32m24.50364476s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.995910724 (11h32m24.511013304s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.996610690 (11h32m24.511713266s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.999701015 (11h32m24.514803592s) [noise=true , address=104.36.82.61:4405 , piece_id=IOUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.008965761 (11h32m24.524068325s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.017145206 (11h32m24.532247782s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.022781027 (11h32m24.537883606s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.023398509 (11h32m24.53850109s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.043528291 (11h32m24.558630869s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.046437033 (11h32m24.561539599s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.087365961 (11h32m24.602468531s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.160388869 (11h32m24.675491445s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.301621081 (11h32m24.816723645s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466287316 (11h32m24.981389887s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466310392 (11h32m24.981412969s) [seg_pos={0 0}, upload=11997]: Segment reached optimal threshold of 14 pieces. Aug 7 21:11:50.466545670 (11h32m24.981648233s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.466997931 (11h32m24.982100496s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467162262 (11h32m24.982264825s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467246223 (11h32m24.982348803s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467281805 (11h32m24.982384369s) [seg_pos={0 0}, upload=11997]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:11:50.467362207 (11h32m24.982464787s) [upload=11997]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:11:50.467367803 (11h32m24.982470386s) [upload=11997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:57.502219885 (11h33m32.017322462s) [upload=11997]: Done uploading segments... Aug 7 21:12:57.502247705 (11h33m32.017350283s) [upload=11997]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:12:57.635219958 (11h33m32.150322528s) [upload=12020]: Starting upload Aug 7 21:12:57.635291431 (11h33m32.150394007s) [upload=12020]: Done starting upload Aug 7 21:12:57.635412367 (11h33m32.150514934s) [upload=12020]: Uploading segments... Aug 7 21:12:57.635706561 (11h33m32.150809138s) [upload=12020]: Got next segment. Inline: false Aug 7 21:12:57.635807146 (11h33m32.150909713s) [upload=12020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:57.635812366 (11h33m32.150914942s) [upload=12020]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:13:57.598803233 (11h34m32.113905819s) [upload=12020]: Next segment err: context deadline exceeded Aug 7 21:13:57.598926914 (11h34m32.114029476s) [upload=12020]: Done uploading segments... Aug 7 21:13:57.598944574 (11h34m32.114047136s) [upload=12020]: Upload finished. err: context deadline exceeded Aug 7 21:13:57.707893490 (11h34m32.222996072s) [upload=12034]: Starting upload Aug 7 21:13:57.708008457 (11h34m32.223111035s) [upload=12034]: Done starting upload Aug 7 21:13:57.708257239 (11h34m32.223359807s) [upload=12034]: Uploading segments... Aug 7 21:13:57.708628569 (11h34m32.223731149s) [upload=12034]: Got next segment. Inline: false Aug 7 21:13:57.708697917 (11h34m32.2238005s) [upload=12034]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:57.708703428 (11h34m32.223806004s) [upload=12034]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:14:57.677372272 (11h35m32.19247486s) [upload=12034]: Next segment err: context deadline exceeded Aug 7 21:14:57.677532945 (11h35m32.192635511s) [upload=12034]: Done uploading segments... Aug 7 21:14:57.677558723 (11h35m32.192661287s) [upload=12034]: Upload finished. err: context deadline exceeded Aug 7 21:14:57.906428111 (11h35m32.421530675s) [upload=12052]: Starting upload Aug 7 21:14:57.906515646 (11h35m32.421618231s) [upload=12052]: Done starting upload Aug 7 21:14:57.906583348 (11h35m32.421685918s) [upload=12052]: Uploading segments... Aug 7 21:14:57.907007505 (11h35m32.422110088s) [upload=12052]: Got next segment. Inline: false Aug 7 21:14:57.907095500 (11h35m32.42219808s) [upload=12052]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:57.907102983 (11h35m32.422205563s) [upload=12052]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:15:57.857675330 (11h36m32.372777915s) [upload=12052]: Next segment err: context deadline exceeded Aug 7 21:15:57.857827342 (11h36m32.372929919s) [upload=12052]: Done uploading segments... Aug 7 21:15:57.857845992 (11h36m32.372948573s) [upload=12052]: Upload finished. err: context deadline exceeded Aug 7 21:16:05.804869311 (11h36m40.319971891s) [upload=12067]: Starting upload Aug 7 21:16:05.804961392 (11h36m40.32006397s) [upload=12067]: Done starting upload Aug 7 21:16:05.805366037 (11h36m40.320468613s) [upload=12067]: Uploading segments... Aug 7 21:16:05.805444950 (11h36m40.320547537s) [upload=12067]: Got next segment. Inline: false Aug 7 21:16:05.805524445 (11h36m40.320627032s) [upload=12067]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:16:05.805530950 (11h36m40.320633522s) [upload=12067]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:17:05.764865199 (11h37m40.279967765s) [upload=12067]: Next segment err: context deadline exceeded Aug 7 21:17:05.764907057 (11h37m40.280009637s) [upload=12067]: Done uploading segments... Aug 7 21:17:05.764922340 (11h37m40.280024907s) [upload=12067]: Upload finished. err: context deadline exceeded Duration: 1m0.001101462s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 1m0.001227781s FAIL (2025-08-07 21:16:52 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001241246s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 5 out of 60 is failed (threshold=3) [.......................................................XXXXX] duration: 30.000545648s FAIL (2025-08-07 21:16:51 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000578542s core uplink us1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 2m0.0007061s remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-07 21:16:44 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 2m0.00072716s edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.001329098s FAIL (2025-08-07 21:16:36 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00135345s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [......................................................X..XXX] duration: 30.000631596s FAIL (2025-08-07 21:16:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000646954s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................................................X.XX] duration: 30.001654283s FAIL (2025-08-07 21:16:23 UTC) operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 11919]: Upload finished. err: <nil> Aug 7 21:08:01.094338764 (11h28m35.609441348s) [upload=11937]: Starting upload Aug 7 21:08:01.094439624 (11h28m35.609542203s) [upload=11937]: Done starting upload Aug 7 21:08:01.094530817 (11h28m35.609633396s) [upload=11937]: Uploading segments... Aug 7 21:08:01.094614230 (11h28m35.609716816s) [upload=11937]: Got next segment. Inline: true Aug 7 21:08:01.094621916 (11h28m35.609724497s) [upload=11937]: Waiting for error group managing segments... Aug 7 21:08:01.094683972 (11h28m35.609786552s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:08:01.094691937 (11h28m35.609794517s) [upload=11937]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:01.094697155 (11h28m35.609799732s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:08:01.161630100 (11h28m35.676732674s) [upload=11937]: Done uploading segments... Aug 7 21:08:01.161650889 (11h28m35.676753468s) [upload=11937]: Upload finished. err: <nil> Aug 7 21:09:09.556774580 (11h29m44.071877161s) [upload=11956]: Starting upload Aug 7 21:09:09.556869520 (11h29m44.071972101s) [upload=11956]: Done starting upload Aug 7 21:09:09.556938280 (11h29m44.072040846s) [upload=11956]: Uploading segments... Aug 7 21:09:09.557010711 (11h29m44.072113296s) [upload=11956]: Got next segment. Inline: true Aug 7 21:09:09.557016786 (11h29m44.072119352s) [upload=11956]: Waiting for error group managing segments... Aug 7 21:09:09.557085460 (11h29m44.072188039s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:09.557091284 (11h29m44.07219386s) [upload=11956]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:09.557094925 (11h29m44.072197502s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:09.747686849 (11h29m44.262789432s) [upload=11956]: Done uploading segments... Aug 7 21:09:09.747707829 (11h29m44.262810399s) [upload=11956]: Upload finished. err: <nil> Aug 7 21:09:59.461356278 (11h30m33.976458859s) [upload=11970]: Starting upload Aug 7 21:09:59.461514228 (11h30m33.976616814s) [upload=11970]: Done starting upload Aug 7 21:09:59.461657967 (11h30m33.976760542s) [upload=11970]: Uploading segments... Aug 7 21:09:59.461728003 (11h30m33.976830589s) [upload=11970]: Got next segment. Inline: true Aug 7 21:09:59.461733779 (11h30m33.976836356s) [upload=11970]: Waiting for error group managing segments... Aug 7 21:09:59.461777635 (11h30m33.976880202s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:59.461783114 (11h30m33.97688569s) [upload=11970]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:59.461787951 (11h30m33.976890529s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:59.731460482 (11h30m34.246563058s) [upload=11970]: Done uploading segments... Aug 7 21:09:59.731478076 (11h30m34.246580652s) [upload=11970]: Upload finished. err: <nil> Aug 7 21:10:42.945656363 (11h31m17.460758936s) [upload=11982]: Starting upload Aug 7 21:10:42.945741284 (11h31m17.460843863s) [upload=11982]: Done starting upload Aug 7 21:10:42.945850852 (11h31m17.46095342s) [upload=11982]: Uploading segments... Aug 7 21:10:42.945892389 (11h31m17.460994975s) [upload=11982]: Got next segment. Inline: true Aug 7 21:10:42.945897243 (11h31m17.460999819s) [upload=11982]: Waiting for error group managing segments... Aug 7 21:10:42.945957561 (11h31m17.461060137s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:42.945962699 (11h31m17.461065276s) [upload=11982]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:42.945965846 (11h31m17.461068421s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:43.061691785 (11h31m17.576794373s) [upload=11982]: Done uploading segments... Aug 7 21:10:43.061710851 (11h31m17.576813425s) [upload=11982]: Upload finished. err: <nil> Aug 7 21:11:55.646673634 (11h32m30.161776203s) [upload=12003]: Starting upload Aug 7 21:11:55.646725223 (11h32m30.161827806s) [upload=12003]: Done starting upload Aug 7 21:11:55.646793999 (11h32m30.161896566s) [upload=12003]: Uploading segments... Aug 7 21:11:55.646853254 (11h32m30.161955836s) [upload=12003]: Got next segment. Inline: true Aug 7 21:11:55.646858259 (11h32m30.161960835s) [upload=12003]: Waiting for error group managing segments... Aug 7 21:11:55.646908687 (11h32m30.162011263s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:55.646914002 (11h32m30.162016583s) [upload=12003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:55.646918834 (11h32m30.162021413s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:55.718218370 (11h32m30.233320937s) [upload=12003]: Done uploading segments... Aug 7 21:11:55.718234789 (11h32m30.233337359s) [upload=12003]: Upload finished. err: <nil> Aug 7 21:12:27.468174562 (11h33m1.983277139s) [upload=12010]: Starting upload Aug 7 21:12:27.468269218 (11h33m1.983371788s) [upload=12010]: Done starting upload Aug 7 21:12:27.468432459 (11h33m1.983535027s) [upload=12010]: Uploading segments... Aug 7 21:12:27.468502812 (11h33m1.983605391s) [upload=12010]: Got next segment. Inline: true Aug 7 21:12:27.468509793 (11h33m1.983612369s) [upload=12010]: Waiting for error group managing segments... Aug 7 21:12:27.468577961 (11h33m1.983680537s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:27.468583494 (11h33m1.98368607s) [upload=12010]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:27.468587033 (11h33m1.983689609s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:27.713163795 (11h33m2.228266382s) [upload=12010]: Done uploading segments... Aug 7 21:12:27.713184263 (11h33m2.228286844s) [upload=12010]: Upload finished. err: <nil> Aug 7 21:13:00.260488755 (11h33m34.775591337s) [upload=12021]: Starting upload Aug 7 21:13:00.260589735 (11h33m34.775692306s) [upload=12021]: Done starting upload Aug 7 21:13:00.260688806 (11h33m34.775791377s) [upload=12021]: Uploading segments... Aug 7 21:13:00.260755956 (11h33m34.775858537s) [upload=12021]: Got next segment. Inline: true Aug 7 21:13:00.260760943 (11h33m34.775863519s) [upload=12021]: Waiting for error group managing segments... Aug 7 21:13:00.260825909 (11h33m34.775928474s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:00.260831124 (11h33m34.775933703s) [upload=12021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:00.260834322 (11h33m34.7759369s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:30.231998317 (11h34m4.747100894s) [upload=12021]: Done uploading segments... Aug 7 21:13:30.232017085 (11h34m4.74711966s) [upload=12021]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:13:34.490529998 (11h34m9.005632564s) [upload=12029]: Starting upload Aug 7 21:13:34.490599665 (11h34m9.005702244s) [upload=12029]: Done starting upload Aug 7 21:13:34.490712022 (11h34m9.005814599s) [upload=12029]: Uploading segments... Aug 7 21:13:34.490822609 (11h34m9.005925188s) [upload=12029]: Got next segment. Inline: true Aug 7 21:13:34.490828860 (11h34m9.005931437s) [upload=12029]: Waiting for error group managing segments... Aug 7 21:13:34.490903638 (11h34m9.006006215s) [upload=12029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:34.490908813 (11h34m9.006011379s) [upload=12029]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:34.490911892 (11h34m9.00601446s) [upload=12029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:34.880488092 (11h34m9.39559068s) [upload=12029]: Done uploading segments... Aug 7 21:13:34.880508926 (11h34m9.395611515s) [upload=12029]: Upload finished. err: <nil> Aug 7 21:14:45.394850433 (11h35m19.909953011s) [upload=12049]: Starting upload Aug 7 21:14:45.394946608 (11h35m19.910049187s) [upload=12049]: Done starting upload Aug 7 21:14:45.395065277 (11h35m19.910167846s) [upload=12049]: Uploading segments... Aug 7 21:14:45.395104752 (11h35m19.910207337s) [upload=12049]: Got next segment. Inline: true Aug 7 21:14:45.395110169 (11h35m19.910212745s) [upload=12049]: Waiting for error group managing segments... Aug 7 21:14:45.395152641 (11h35m19.910255207s) [upload=12049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:45.395157021 (11h35m19.910259598s) [upload=12049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:14:45.395161401 (11h35m19.910263982s) [upload=12049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:15:15.359522906 (11h35m49.874625488s) [upload=12049]: Done uploading segments... Aug 7 21:15:15.359549039 (11h35m49.874651622s) [upload=12049]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:15:53.553631580 (11h36m28.068734159s) [upload=12066]: Starting upload Aug 7 21:15:53.553693025 (11h36m28.068795593s) [upload=12066]: Done starting upload Aug 7 21:15:53.553757062 (11h36m28.06885963s) [upload=12066]: Uploading segments... Aug 7 21:15:53.553809335 (11h36m28.068911922s) [upload=12066]: Got next segment. Inline: true Aug 7 21:15:53.553813895 (11h36m28.068916471s) [upload=12066]: Waiting for error group managing segments... Aug 7 21:15:53.553863687 (11h36m28.068966263s) [upload=12066]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:15:53.553867873 (11h36m28.068970453s) [upload=12066]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:15:53.553871084 (11h36m28.068973661s) [upload=12066]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:16:23.520202496 (11h36m58.035305071s) [upload=12066]: Done uploading segments... Aug 7 21:16:23.520223689 (11h36m58.035326265s) [upload=12066]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.001677495s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 30.000823606s FAIL (2025-08-07 21:16:12 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.000848396s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.000623849s FAIL (2025-08-07 21:16:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 939 (11h28m16.602977515s) [upload=11932]: Upload finished. err: <nil> Aug 7 21:08:53.695989769 (11h29m28.211092353s) [upload=11949]: Starting upload Aug 7 21:08:53.696083986 (11h29m28.211186566s) [upload=11949]: Done starting upload Aug 7 21:08:53.696162323 (11h29m28.21126489s) [upload=11949]: Uploading segments... Aug 7 21:08:53.696214073 (11h29m28.21131666s) [upload=11949]: Got next segment. Inline: true Aug 7 21:08:53.696219822 (11h29m28.211322403s) [upload=11949]: Waiting for error group managing segments... Aug 7 21:08:53.696346747 (11h29m28.211449324s) [upload=11949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:08:53.696353895 (11h29m28.211456476s) [upload=11949]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:53.696358505 (11h29m28.211461085s) [upload=11949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:08:53.763567310 (11h29m28.278669899s) [upload=11949]: Done uploading segments... Aug 7 21:08:53.763587753 (11h29m28.278690329s) [upload=11949]: Upload finished. err: <nil> Aug 7 21:09:28.927883911 (11h30m3.442986491s) [upload=11961]: Starting upload Aug 7 21:09:28.927978534 (11h30m3.44308112s) [upload=11961]: Done starting upload Aug 7 21:09:28.928091710 (11h30m3.443194288s) [upload=11961]: Uploading segments... Aug 7 21:09:28.928200886 (11h30m3.443303473s) [upload=11961]: Got next segment. Inline: true Aug 7 21:09:28.928228777 (11h30m3.443331364s) [upload=11961]: Waiting for error group managing segments... Aug 7 21:09:28.928494113 (11h30m3.443596694s) [upload=11961]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:28.928504795 (11h30m3.443607384s) [upload=11961]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:28.928508406 (11h30m3.443610992s) [upload=11961]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:28.988058639 (11h30m3.503161225s) [upload=11961]: Done uploading segments... Aug 7 21:09:28.988080739 (11h30m3.503183322s) [upload=11961]: Upload finished. err: <nil> Aug 7 21:09:51.381222521 (11h30m25.896325102s) [upload=11966]: Starting upload Aug 7 21:09:51.381312517 (11h30m25.896415103s) [upload=11966]: Done starting upload Aug 7 21:09:51.381397386 (11h30m25.896499962s) [upload=11966]: Uploading segments... Aug 7 21:09:51.381448522 (11h30m25.896551107s) [upload=11966]: Got next segment. Inline: true Aug 7 21:09:51.381454533 (11h30m25.896557114s) [upload=11966]: Waiting for error group managing segments... Aug 7 21:09:51.381512553 (11h30m25.896615135s) [upload=11966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:51.381518068 (11h30m25.89662065s) [upload=11966]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:51.381521548 (11h30m25.896624127s) [upload=11966]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:51.448002347 (11h30m25.963104916s) [upload=11966]: Done uploading segments... Aug 7 21:09:51.448032497 (11h30m25.963135063s) [upload=11966]: Upload finished. err: <nil> Aug 7 21:10:10.114714791 (11h30m44.629817371s) [upload=11973]: Starting upload Aug 7 21:10:10.114793168 (11h30m44.629895735s) [upload=11973]: Done starting upload Aug 7 21:10:10.114888340 (11h30m44.629990904s) [upload=11973]: Uploading segments... Aug 7 21:10:10.114944378 (11h30m44.630046964s) [upload=11973]: Got next segment. Inline: true Aug 7 21:10:10.114951005 (11h30m44.630053591s) [upload=11973]: Waiting for error group managing segments... Aug 7 21:10:10.115003955 (11h30m44.630106535s) [upload=11973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:10.115010339 (11h30m44.630112927s) [upload=11973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:10.115014017 (11h30m44.630116599s) [upload=11973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:10.426003751 (11h30m44.941106327s) [upload=11973]: Done uploading segments... Aug 7 21:10:10.426023733 (11h30m44.941126312s) [upload=11973]: Upload finished. err: <nil> Aug 7 21:11:07.821695009 (11h31m42.3367976s) [upload=11989]: Starting upload Aug 7 21:11:07.821828021 (11h31m42.336930607s) [upload=11989]: Done starting upload Aug 7 21:11:07.821974268 (11h31m42.337076852s) [upload=11989]: Uploading segments... Aug 7 21:11:07.822051165 (11h31m42.33715375s) [upload=11989]: Got next segment. Inline: true Aug 7 21:11:07.822058710 (11h31m42.337161296s) [upload=11989]: Waiting for error group managing segments... Aug 7 21:11:07.822137123 (11h31m42.337239714s) [upload=11989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:07.822143163 (11h31m42.33724575s) [upload=11989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:07.822147451 (11h31m42.337250044s) [upload=11989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:07.880868203 (11h31m42.395970789s) [upload=11989]: Done uploading segments... Aug 7 21:11:07.880886229 (11h31m42.395988796s) [upload=11989]: Upload finished. err: <nil> Aug 7 21:11:30.967897030 (11h32m5.482999597s) [upload=11995]: Starting upload Aug 7 21:11:30.967969502 (11h32m5.483072083s) [upload=11995]: Done starting upload Aug 7 21:11:30.968040172 (11h32m5.483142743s) [upload=11995]: Uploading segments... Aug 7 21:11:30.968088031 (11h32m5.483190618s) [upload=11995]: Got next segment. Inline: true Aug 7 21:11:30.968092912 (11h32m5.483195492s) [upload=11995]: Waiting for error group managing segments... Aug 7 21:11:30.968156155 (11h32m5.483258717s) [upload=11995]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:30.968160963 (11h32m5.483263526s) [upload=11995]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:30.968163832 (11h32m5.483266409s) [upload=11995]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:31.040679973 (11h32m5.555782542s) [upload=11995]: Done uploading segments... Aug 7 21:11:31.040697828 (11h32m5.555800393s) [upload=11995]: Upload finished. err: <nil> Aug 7 21:12:44.577632884 (11h33m19.092735462s) [upload=12014]: Starting upload Aug 7 21:12:44.577718424 (11h33m19.092821007s) [upload=12014]: Done starting upload Aug 7 21:12:44.577778064 (11h33m19.09288064s) [upload=12014]: Uploading segments... Aug 7 21:12:44.577870249 (11h33m19.09297311s) [upload=12014]: Got next segment. Inline: true Aug 7 21:12:44.577878347 (11h33m19.09298093s) [upload=12014]: Waiting for error group managing segments... Aug 7 21:12:44.577949813 (11h33m19.093052392s) [upload=12014]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:44.577956047 (11h33m19.093058626s) [upload=12014]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:44.577963216 (11h33m19.093065803s) [upload=12014]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:44.741155623 (11h33m19.256258199s) [upload=12014]: Done uploading segments... Aug 7 21:12:44.741173325 (11h33m19.256275891s) [upload=12014]: Upload finished. err: <nil> Aug 7 21:13:22.079763163 (11h33m56.594865742s) [upload=12027]: Starting upload Aug 7 21:13:22.079827372 (11h33m56.594929946s) [upload=12027]: Done starting upload Aug 7 21:13:22.079907596 (11h33m56.595010178s) [upload=12027]: Uploading segments... Aug 7 21:13:22.079966866 (11h33m56.595069445s) [upload=12027]: Got next segment. Inline: true Aug 7 21:13:22.079973866 (11h33m56.595076443s) [upload=12027]: Waiting for error group managing segments... Aug 7 21:13:22.080019901 (11h33m56.595122472s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:22.080024370 (11h33m56.595126947s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:22.080029157 (11h33m56.595131732s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:22.199851686 (11h33m56.714954269s) [upload=12027]: Done uploading segments... Aug 7 21:13:22.199871202 (11h33m56.714973784s) [upload=12027]: Upload finished. err: <nil> Aug 7 21:14:11.619394074 (11h34m46.134496661s) [upload=12040]: Starting upload Aug 7 21:14:11.619503144 (11h34m46.134605739s) [upload=12040]: Done starting upload Aug 7 21:14:11.619622676 (11h34m46.13472524s) [upload=12040]: Uploading segments... Aug 7 21:14:11.619678842 (11h34m46.134781443s) [upload=12040]: Got next segment. Inline: true Aug 7 21:14:11.619698988 (11h34m46.134801579s) [upload=12040]: Waiting for error group managing segments... Aug 7 21:14:11.619745714 (11h34m46.1348483s) [upload=12040]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:11.619750849 (11h34m46.134853438s) [upload=12040]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:14:11.619754200 (11h34m46.134856779s) [upload=12040]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:15:11.587599715 (11h35m46.102702292s) [upload=12040]: Done uploading segments... Aug 7 21:15:11.587622036 (11h35m46.102724617s) [upload=12040]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:15:11.944029087 (11h35m46.459131673s) [upload=12059]: Starting upload Aug 7 21:15:11.944115611 (11h35m46.459218173s) [upload=12059]: Done starting upload Aug 7 21:15:11.944188828 (11h35m46.459291405s) [upload=12059]: Uploading segments... Aug 7 21:15:11.944299925 (11h35m46.459402511s) [upload=12059]: Got next segment. Inline: true Aug 7 21:15:11.944487606 (11h35m46.459590195s) [upload=12059]: Waiting for error group managing segments... Aug 7 21:15:11.944583177 (11h35m46.459685757s) [upload=12059]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:15:11.944589579 (11h35m46.459692164s) [upload=12059]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:15:11.944593842 (11h35m46.459696426s) [upload=12059]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:16:11.913962661 (11h36m46.429065258s) [upload=12059]: Done uploading segments... Aug 7 21:16:11.914008028 (11h36m46.429110614s) [upload=12059]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.000673718s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.000913664s FAIL (2025-08-07 21:15:58 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.00094649s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................X..XX] duration: 30.000964969s FAIL (2025-08-07 21:15:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.00099432s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.001197979s FAIL (2025-08-07 21:15:57 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 24.391751878s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877055376 (11h32m24.392157964s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877448982 (11h32m24.39255157s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877851712 (11h32m24.3929543s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878256545 (11h32m24.393359132s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878707848 (11h32m24.393810434s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879171370 (11h32m24.39427396s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879563499 (11h32m24.394666085s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879928199 (11h32m24.395030797s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.974975266 (11h32m24.490077832s) [upload=11997]: Next returned nil segment Aug 7 21:11:49.974994144 (11h32m24.49009672s) [upload=11997]: Waiting for error group managing segments... Aug 7 21:11:49.988542190 (11h32m24.50364476s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.995910724 (11h32m24.511013304s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.996610690 (11h32m24.511713266s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.999701015 (11h32m24.514803592s) [noise=true , address=104.36.82.61:4405 , piece_id=IOUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.008965761 (11h32m24.524068325s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.017145206 (11h32m24.532247782s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.022781027 (11h32m24.537883606s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.023398509 (11h32m24.53850109s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.043528291 (11h32m24.558630869s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.046437033 (11h32m24.561539599s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.087365961 (11h32m24.602468531s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.160388869 (11h32m24.675491445s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.301621081 (11h32m24.816723645s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466287316 (11h32m24.981389887s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466310392 (11h32m24.981412969s) [seg_pos={0 0}, upload=11997]: Segment reached optimal threshold of 14 pieces. Aug 7 21:11:50.466545670 (11h32m24.981648233s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.466997931 (11h32m24.982100496s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467162262 (11h32m24.982264825s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467246223 (11h32m24.982348803s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467281805 (11h32m24.982384369s) [seg_pos={0 0}, upload=11997]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:11:50.467362207 (11h32m24.982464787s) [upload=11997]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:11:50.467367803 (11h32m24.982470386s) [upload=11997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:57.502219885 (11h33m32.017322462s) [upload=11997]: Done uploading segments... Aug 7 21:12:57.502247705 (11h33m32.017350283s) [upload=11997]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:12:57.635219958 (11h33m32.150322528s) [upload=12020]: Starting upload Aug 7 21:12:57.635291431 (11h33m32.150394007s) [upload=12020]: Done starting upload Aug 7 21:12:57.635412367 (11h33m32.150514934s) [upload=12020]: Uploading segments... Aug 7 21:12:57.635706561 (11h33m32.150809138s) [upload=12020]: Got next segment. Inline: false Aug 7 21:12:57.635807146 (11h33m32.150909713s) [upload=12020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:57.635812366 (11h33m32.150914942s) [upload=12020]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:13:57.598803233 (11h34m32.113905819s) [upload=12020]: Next segment err: context deadline exceeded Aug 7 21:13:57.598926914 (11h34m32.114029476s) [upload=12020]: Done uploading segments... Aug 7 21:13:57.598944574 (11h34m32.114047136s) [upload=12020]: Upload finished. err: context deadline exceeded Aug 7 21:13:57.707893490 (11h34m32.222996072s) [upload=12034]: Starting upload Aug 7 21:13:57.708008457 (11h34m32.223111035s) [upload=12034]: Done starting upload Aug 7 21:13:57.708257239 (11h34m32.223359807s) [upload=12034]: Uploading segments... Aug 7 21:13:57.708628569 (11h34m32.223731149s) [upload=12034]: Got next segment. Inline: false Aug 7 21:13:57.708697917 (11h34m32.2238005s) [upload=12034]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:57.708703428 (11h34m32.223806004s) [upload=12034]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:14:57.677372272 (11h35m32.19247486s) [upload=12034]: Next segment err: context deadline exceeded Aug 7 21:14:57.677532945 (11h35m32.192635511s) [upload=12034]: Done uploading segments... Aug 7 21:14:57.677558723 (11h35m32.192661287s) [upload=12034]: Upload finished. err: context deadline exceeded Aug 7 21:14:57.906428111 (11h35m32.421530675s) [upload=12052]: Starting upload Aug 7 21:14:57.906515646 (11h35m32.421618231s) [upload=12052]: Done starting upload Aug 7 21:14:57.906583348 (11h35m32.421685918s) [upload=12052]: Uploading segments... Aug 7 21:14:57.907007505 (11h35m32.422110088s) [upload=12052]: Got next segment. Inline: false Aug 7 21:14:57.907095500 (11h35m32.42219808s) [upload=12052]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:57.907102983 (11h35m32.422205563s) [upload=12052]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:15:57.857675330 (11h36m32.372777915s) [upload=12052]: Next segment err: context deadline exceeded Aug 7 21:15:57.857827342 (11h36m32.372929919s) [upload=12052]: Done uploading segments... Aug 7 21:15:57.857845992 (11h36m32.372948573s) [upload=12052]: Upload finished. err: context deadline exceeded Duration: 1m0.001213963s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................................................XXXX] duration: 1m0.001183806s FAIL (2025-08-07 21:15:52 UTC) operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001199391s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.000989366s FAIL (2025-08-07 21:15:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001013546s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000843827s FAIL (2025-08-07 21:15:28 UTC) orbiter warning: operation: sync2.Copy uplink: encryption: context deadline exceeded Duration: 30.000882002s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 30.001135269s FAIL (2025-08-07 21:15:28 UTC) operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001160205s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................................X.X] duration: 30.000895958s FAIL (2025-08-07 21:15:15 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== 769835 (11h26m10.25587241s) [upload=11901]: Upload finished. err: <nil> Aug 7 21:06:46.230520674 (11h27m20.74562325s) [upload=11919]: Starting upload Aug 7 21:06:46.230607961 (11h27m20.745710539s) [upload=11919]: Done starting upload Aug 7 21:06:46.230686288 (11h27m20.745788854s) [upload=11919]: Uploading segments... Aug 7 21:06:46.230742531 (11h27m20.7458459s) [upload=11919]: Got next segment. Inline: true Aug 7 21:06:46.230751102 (11h27m20.745853666s) [upload=11919]: Waiting for error group managing segments... Aug 7 21:06:46.230820637 (11h27m20.745923214s) [upload=11919]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:06:46.230826241 (11h27m20.74592881s) [upload=11919]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:06:46.230830757 (11h27m20.74593334s) [upload=11919]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:06:46.307287404 (11h27m20.822389968s) [upload=11919]: Done uploading segments... Aug 7 21:06:46.307304611 (11h27m20.822407182s) [upload=11919]: Upload finished. err: <nil> Aug 7 21:08:01.094338764 (11h28m35.609441348s) [upload=11937]: Starting upload Aug 7 21:08:01.094439624 (11h28m35.609542203s) [upload=11937]: Done starting upload Aug 7 21:08:01.094530817 (11h28m35.609633396s) [upload=11937]: Uploading segments... Aug 7 21:08:01.094614230 (11h28m35.609716816s) [upload=11937]: Got next segment. Inline: true Aug 7 21:08:01.094621916 (11h28m35.609724497s) [upload=11937]: Waiting for error group managing segments... Aug 7 21:08:01.094683972 (11h28m35.609786552s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:08:01.094691937 (11h28m35.609794517s) [upload=11937]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:01.094697155 (11h28m35.609799732s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:08:01.161630100 (11h28m35.676732674s) [upload=11937]: Done uploading segments... Aug 7 21:08:01.161650889 (11h28m35.676753468s) [upload=11937]: Upload finished. err: <nil> Aug 7 21:09:09.556774580 (11h29m44.071877161s) [upload=11956]: Starting upload Aug 7 21:09:09.556869520 (11h29m44.071972101s) [upload=11956]: Done starting upload Aug 7 21:09:09.556938280 (11h29m44.072040846s) [upload=11956]: Uploading segments... Aug 7 21:09:09.557010711 (11h29m44.072113296s) [upload=11956]: Got next segment. Inline: true Aug 7 21:09:09.557016786 (11h29m44.072119352s) [upload=11956]: Waiting for error group managing segments... Aug 7 21:09:09.557085460 (11h29m44.072188039s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:09.557091284 (11h29m44.07219386s) [upload=11956]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:09.557094925 (11h29m44.072197502s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:09.747686849 (11h29m44.262789432s) [upload=11956]: Done uploading segments... Aug 7 21:09:09.747707829 (11h29m44.262810399s) [upload=11956]: Upload finished. err: <nil> Aug 7 21:09:59.461356278 (11h30m33.976458859s) [upload=11970]: Starting upload Aug 7 21:09:59.461514228 (11h30m33.976616814s) [upload=11970]: Done starting upload Aug 7 21:09:59.461657967 (11h30m33.976760542s) [upload=11970]: Uploading segments... Aug 7 21:09:59.461728003 (11h30m33.976830589s) [upload=11970]: Got next segment. Inline: true Aug 7 21:09:59.461733779 (11h30m33.976836356s) [upload=11970]: Waiting for error group managing segments... Aug 7 21:09:59.461777635 (11h30m33.976880202s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:59.461783114 (11h30m33.97688569s) [upload=11970]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:59.461787951 (11h30m33.976890529s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:59.731460482 (11h30m34.246563058s) [upload=11970]: Done uploading segments... Aug 7 21:09:59.731478076 (11h30m34.246580652s) [upload=11970]: Upload finished. err: <nil> Aug 7 21:10:42.945656363 (11h31m17.460758936s) [upload=11982]: Starting upload Aug 7 21:10:42.945741284 (11h31m17.460843863s) [upload=11982]: Done starting upload Aug 7 21:10:42.945850852 (11h31m17.46095342s) [upload=11982]: Uploading segments... Aug 7 21:10:42.945892389 (11h31m17.460994975s) [upload=11982]: Got next segment. Inline: true Aug 7 21:10:42.945897243 (11h31m17.460999819s) [upload=11982]: Waiting for error group managing segments... Aug 7 21:10:42.945957561 (11h31m17.461060137s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:42.945962699 (11h31m17.461065276s) [upload=11982]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:42.945965846 (11h31m17.461068421s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:43.061691785 (11h31m17.576794373s) [upload=11982]: Done uploading segments... Aug 7 21:10:43.061710851 (11h31m17.576813425s) [upload=11982]: Upload finished. err: <nil> Aug 7 21:11:55.646673634 (11h32m30.161776203s) [upload=12003]: Starting upload Aug 7 21:11:55.646725223 (11h32m30.161827806s) [upload=12003]: Done starting upload Aug 7 21:11:55.646793999 (11h32m30.161896566s) [upload=12003]: Uploading segments... Aug 7 21:11:55.646853254 (11h32m30.161955836s) [upload=12003]: Got next segment. Inline: true Aug 7 21:11:55.646858259 (11h32m30.161960835s) [upload=12003]: Waiting for error group managing segments... Aug 7 21:11:55.646908687 (11h32m30.162011263s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:55.646914002 (11h32m30.162016583s) [upload=12003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:55.646918834 (11h32m30.162021413s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:55.718218370 (11h32m30.233320937s) [upload=12003]: Done uploading segments... Aug 7 21:11:55.718234789 (11h32m30.233337359s) [upload=12003]: Upload finished. err: <nil> Aug 7 21:12:27.468174562 (11h33m1.983277139s) [upload=12010]: Starting upload Aug 7 21:12:27.468269218 (11h33m1.983371788s) [upload=12010]: Done starting upload Aug 7 21:12:27.468432459 (11h33m1.983535027s) [upload=12010]: Uploading segments... Aug 7 21:12:27.468502812 (11h33m1.983605391s) [upload=12010]: Got next segment. Inline: true Aug 7 21:12:27.468509793 (11h33m1.983612369s) [upload=12010]: Waiting for error group managing segments... Aug 7 21:12:27.468577961 (11h33m1.983680537s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:27.468583494 (11h33m1.98368607s) [upload=12010]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:27.468587033 (11h33m1.983689609s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:27.713163795 (11h33m2.228266382s) [upload=12010]: Done uploading segments... Aug 7 21:12:27.713184263 (11h33m2.228286844s) [upload=12010]: Upload finished. err: <nil> Aug 7 21:13:00.260488755 (11h33m34.775591337s) [upload=12021]: Starting upload Aug 7 21:13:00.260589735 (11h33m34.775692306s) [upload=12021]: Done starting upload Aug 7 21:13:00.260688806 (11h33m34.775791377s) [upload=12021]: Uploading segments... Aug 7 21:13:00.260755956 (11h33m34.775858537s) [upload=12021]: Got next segment. Inline: true Aug 7 21:13:00.260760943 (11h33m34.775863519s) [upload=12021]: Waiting for error group managing segments... Aug 7 21:13:00.260825909 (11h33m34.775928474s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:00.260831124 (11h33m34.775933703s) [upload=12021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:00.260834322 (11h33m34.7759369s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:30.231998317 (11h34m4.747100894s) [upload=12021]: Done uploading segments... Aug 7 21:13:30.232017085 (11h34m4.74711966s) [upload=12021]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:13:34.490529998 (11h34m9.005632564s) [upload=12029]: Starting upload Aug 7 21:13:34.490599665 (11h34m9.005702244s) [upload=12029]: Done starting upload Aug 7 21:13:34.490712022 (11h34m9.005814599s) [upload=12029]: Uploading segments... Aug 7 21:13:34.490822609 (11h34m9.005925188s) [upload=12029]: Got next segment. Inline: true Aug 7 21:13:34.490828860 (11h34m9.005931437s) [upload=12029]: Waiting for error group managing segments... Aug 7 21:13:34.490903638 (11h34m9.006006215s) [upload=12029]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:34.490908813 (11h34m9.006011379s) [upload=12029]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:34.490911892 (11h34m9.00601446s) [upload=12029]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:34.880488092 (11h34m9.39559068s) [upload=12029]: Done uploading segments... Aug 7 21:13:34.880508926 (11h34m9.395611515s) [upload=12029]: Upload finished. err: <nil> Aug 7 21:14:45.394850433 (11h35m19.909953011s) [upload=12049]: Starting upload Aug 7 21:14:45.394946608 (11h35m19.910049187s) [upload=12049]: Done starting upload Aug 7 21:14:45.395065277 (11h35m19.910167846s) [upload=12049]: Uploading segments... Aug 7 21:14:45.395104752 (11h35m19.910207337s) [upload=12049]: Got next segment. Inline: true Aug 7 21:14:45.395110169 (11h35m19.910212745s) [upload=12049]: Waiting for error group managing segments... Aug 7 21:14:45.395152641 (11h35m19.910255207s) [upload=12049]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:45.395157021 (11h35m19.910259598s) [upload=12049]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:14:45.395161401 (11h35m19.910263982s) [upload=12049]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:15:15.359522906 (11h35m49.874625488s) [upload=12049]: Done uploading segments... Aug 7 21:15:15.359549039 (11h35m49.874651622s) [upload=12049]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.0009195s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.000728482s FAIL (2025-08-07 21:15:11 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== egments... Aug 7 21:06:53.974021205 (11h27m28.489123767s) [upload=11923]: Upload finished. err: <nil> Aug 7 21:07:42.015408784 (11h28m16.530511358s) [upload=11932]: Starting upload Aug 7 21:07:42.015497335 (11h28m16.530599914s) [upload=11932]: Done starting upload Aug 7 21:07:42.015591987 (11h28m16.53069455s) [upload=11932]: Uploading segments... Aug 7 21:07:42.015674803 (11h28m16.530777373s) [upload=11932]: Got next segment. Inline: true Aug 7 21:07:42.015700695 (11h28m16.530803272s) [upload=11932]: Waiting for error group managing segments... Aug 7 21:07:42.015754888 (11h28m16.530857454s) [upload=11932]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:07:42.015760054 (11h28m16.530862631s) [upload=11932]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:07:42.015782275 (11h28m16.530884869s) [upload=11932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:07:42.087858362 (11h28m16.602960938s) [upload=11932]: Done uploading segments... Aug 7 21:07:42.087874939 (11h28m16.602977515s) [upload=11932]: Upload finished. err: <nil> Aug 7 21:08:53.695989769 (11h29m28.211092353s) [upload=11949]: Starting upload Aug 7 21:08:53.696083986 (11h29m28.211186566s) [upload=11949]: Done starting upload Aug 7 21:08:53.696162323 (11h29m28.21126489s) [upload=11949]: Uploading segments... Aug 7 21:08:53.696214073 (11h29m28.21131666s) [upload=11949]: Got next segment. Inline: true Aug 7 21:08:53.696219822 (11h29m28.211322403s) [upload=11949]: Waiting for error group managing segments... Aug 7 21:08:53.696346747 (11h29m28.211449324s) [upload=11949]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:08:53.696353895 (11h29m28.211456476s) [upload=11949]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:53.696358505 (11h29m28.211461085s) [upload=11949]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:08:53.763567310 (11h29m28.278669899s) [upload=11949]: Done uploading segments... Aug 7 21:08:53.763587753 (11h29m28.278690329s) [upload=11949]: Upload finished. err: <nil> Aug 7 21:09:28.927883911 (11h30m3.442986491s) [upload=11961]: Starting upload Aug 7 21:09:28.927978534 (11h30m3.44308112s) [upload=11961]: Done starting upload Aug 7 21:09:28.928091710 (11h30m3.443194288s) [upload=11961]: Uploading segments... Aug 7 21:09:28.928200886 (11h30m3.443303473s) [upload=11961]: Got next segment. Inline: true Aug 7 21:09:28.928228777 (11h30m3.443331364s) [upload=11961]: Waiting for error group managing segments... Aug 7 21:09:28.928494113 (11h30m3.443596694s) [upload=11961]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:28.928504795 (11h30m3.443607384s) [upload=11961]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:28.928508406 (11h30m3.443610992s) [upload=11961]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:28.988058639 (11h30m3.503161225s) [upload=11961]: Done uploading segments... Aug 7 21:09:28.988080739 (11h30m3.503183322s) [upload=11961]: Upload finished. err: <nil> Aug 7 21:09:51.381222521 (11h30m25.896325102s) [upload=11966]: Starting upload Aug 7 21:09:51.381312517 (11h30m25.896415103s) [upload=11966]: Done starting upload Aug 7 21:09:51.381397386 (11h30m25.896499962s) [upload=11966]: Uploading segments... Aug 7 21:09:51.381448522 (11h30m25.896551107s) [upload=11966]: Got next segment. Inline: true Aug 7 21:09:51.381454533 (11h30m25.896557114s) [upload=11966]: Waiting for error group managing segments... Aug 7 21:09:51.381512553 (11h30m25.896615135s) [upload=11966]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:51.381518068 (11h30m25.89662065s) [upload=11966]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:51.381521548 (11h30m25.896624127s) [upload=11966]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:51.448002347 (11h30m25.963104916s) [upload=11966]: Done uploading segments... Aug 7 21:09:51.448032497 (11h30m25.963135063s) [upload=11966]: Upload finished. err: <nil> Aug 7 21:10:10.114714791 (11h30m44.629817371s) [upload=11973]: Starting upload Aug 7 21:10:10.114793168 (11h30m44.629895735s) [upload=11973]: Done starting upload Aug 7 21:10:10.114888340 (11h30m44.629990904s) [upload=11973]: Uploading segments... Aug 7 21:10:10.114944378 (11h30m44.630046964s) [upload=11973]: Got next segment. Inline: true Aug 7 21:10:10.114951005 (11h30m44.630053591s) [upload=11973]: Waiting for error group managing segments... Aug 7 21:10:10.115003955 (11h30m44.630106535s) [upload=11973]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:10.115010339 (11h30m44.630112927s) [upload=11973]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:10.115014017 (11h30m44.630116599s) [upload=11973]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:10.426003751 (11h30m44.941106327s) [upload=11973]: Done uploading segments... Aug 7 21:10:10.426023733 (11h30m44.941126312s) [upload=11973]: Upload finished. err: <nil> Aug 7 21:11:07.821695009 (11h31m42.3367976s) [upload=11989]: Starting upload Aug 7 21:11:07.821828021 (11h31m42.336930607s) [upload=11989]: Done starting upload Aug 7 21:11:07.821974268 (11h31m42.337076852s) [upload=11989]: Uploading segments... Aug 7 21:11:07.822051165 (11h31m42.33715375s) [upload=11989]: Got next segment. Inline: true Aug 7 21:11:07.822058710 (11h31m42.337161296s) [upload=11989]: Waiting for error group managing segments... Aug 7 21:11:07.822137123 (11h31m42.337239714s) [upload=11989]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:07.822143163 (11h31m42.33724575s) [upload=11989]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:07.822147451 (11h31m42.337250044s) [upload=11989]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:07.880868203 (11h31m42.395970789s) [upload=11989]: Done uploading segments... Aug 7 21:11:07.880886229 (11h31m42.395988796s) [upload=11989]: Upload finished. err: <nil> Aug 7 21:11:30.967897030 (11h32m5.482999597s) [upload=11995]: Starting upload Aug 7 21:11:30.967969502 (11h32m5.483072083s) [upload=11995]: Done starting upload Aug 7 21:11:30.968040172 (11h32m5.483142743s) [upload=11995]: Uploading segments... Aug 7 21:11:30.968088031 (11h32m5.483190618s) [upload=11995]: Got next segment. Inline: true Aug 7 21:11:30.968092912 (11h32m5.483195492s) [upload=11995]: Waiting for error group managing segments... Aug 7 21:11:30.968156155 (11h32m5.483258717s) [upload=11995]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:30.968160963 (11h32m5.483263526s) [upload=11995]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:30.968163832 (11h32m5.483266409s) [upload=11995]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:31.040679973 (11h32m5.555782542s) [upload=11995]: Done uploading segments... Aug 7 21:11:31.040697828 (11h32m5.555800393s) [upload=11995]: Upload finished. err: <nil> Aug 7 21:12:44.577632884 (11h33m19.092735462s) [upload=12014]: Starting upload Aug 7 21:12:44.577718424 (11h33m19.092821007s) [upload=12014]: Done starting upload Aug 7 21:12:44.577778064 (11h33m19.09288064s) [upload=12014]: Uploading segments... Aug 7 21:12:44.577870249 (11h33m19.09297311s) [upload=12014]: Got next segment. Inline: true Aug 7 21:12:44.577878347 (11h33m19.09298093s) [upload=12014]: Waiting for error group managing segments... Aug 7 21:12:44.577949813 (11h33m19.093052392s) [upload=12014]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:44.577956047 (11h33m19.093058626s) [upload=12014]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:44.577963216 (11h33m19.093065803s) [upload=12014]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:44.741155623 (11h33m19.256258199s) [upload=12014]: Done uploading segments... Aug 7 21:12:44.741173325 (11h33m19.256275891s) [upload=12014]: Upload finished. err: <nil> Aug 7 21:13:22.079763163 (11h33m56.594865742s) [upload=12027]: Starting upload Aug 7 21:13:22.079827372 (11h33m56.594929946s) [upload=12027]: Done starting upload Aug 7 21:13:22.079907596 (11h33m56.595010178s) [upload=12027]: Uploading segments... Aug 7 21:13:22.079966866 (11h33m56.595069445s) [upload=12027]: Got next segment. Inline: true Aug 7 21:13:22.079973866 (11h33m56.595076443s) [upload=12027]: Waiting for error group managing segments... Aug 7 21:13:22.080019901 (11h33m56.595122472s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:22.080024370 (11h33m56.595126947s) [upload=12027]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:22.080029157 (11h33m56.595131732s) [upload=12027]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:22.199851686 (11h33m56.714954269s) [upload=12027]: Done uploading segments... Aug 7 21:13:22.199871202 (11h33m56.714973784s) [upload=12027]: Upload finished. err: <nil> Aug 7 21:14:11.619394074 (11h34m46.134496661s) [upload=12040]: Starting upload Aug 7 21:14:11.619503144 (11h34m46.134605739s) [upload=12040]: Done starting upload Aug 7 21:14:11.619622676 (11h34m46.13472524s) [upload=12040]: Uploading segments... Aug 7 21:14:11.619678842 (11h34m46.134781443s) [upload=12040]: Got next segment. Inline: true Aug 7 21:14:11.619698988 (11h34m46.134801579s) [upload=12040]: Waiting for error group managing segments... Aug 7 21:14:11.619745714 (11h34m46.1348483s) [upload=12040]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:11.619750849 (11h34m46.134853438s) [upload=12040]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:14:11.619754200 (11h34m46.134856779s) [upload=12040]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:15:11.587599715 (11h35m46.102702292s) [upload=12040]: Done uploading segments... Aug 7 21:15:11.587622036 (11h35m46.102724617s) [upload=12040]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m0.000748296s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 30.000964367s FAIL (2025-08-07 21:15:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000981494s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.001670765s FAIL (2025-08-07 21:14:57 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== , upload=11997]: Uploading piece... Aug 7 21:11:49.874007875 (11h32m24.389110457s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.875394772 (11h32m24.390497359s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.875816032 (11h32m24.39091862s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.876209598 (11h32m24.391312188s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.876649290 (11h32m24.391751878s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877055376 (11h32m24.392157964s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877448982 (11h32m24.39255157s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877851712 (11h32m24.3929543s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878256545 (11h32m24.393359132s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878707848 (11h32m24.393810434s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879171370 (11h32m24.39427396s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879563499 (11h32m24.394666085s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879928199 (11h32m24.395030797s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.974975266 (11h32m24.490077832s) [upload=11997]: Next returned nil segment Aug 7 21:11:49.974994144 (11h32m24.49009672s) [upload=11997]: Waiting for error group managing segments... Aug 7 21:11:49.988542190 (11h32m24.50364476s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.995910724 (11h32m24.511013304s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.996610690 (11h32m24.511713266s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.999701015 (11h32m24.514803592s) [noise=true , address=104.36.82.61:4405 , piece_id=IOUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.008965761 (11h32m24.524068325s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.017145206 (11h32m24.532247782s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.022781027 (11h32m24.537883606s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.023398509 (11h32m24.53850109s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.043528291 (11h32m24.558630869s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.046437033 (11h32m24.561539599s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.087365961 (11h32m24.602468531s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.160388869 (11h32m24.675491445s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.301621081 (11h32m24.816723645s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466287316 (11h32m24.981389887s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466310392 (11h32m24.981412969s) [seg_pos={0 0}, upload=11997]: Segment reached optimal threshold of 14 pieces. Aug 7 21:11:50.466545670 (11h32m24.981648233s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.466997931 (11h32m24.982100496s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467162262 (11h32m24.982264825s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467246223 (11h32m24.982348803s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467281805 (11h32m24.982384369s) [seg_pos={0 0}, upload=11997]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:11:50.467362207 (11h32m24.982464787s) [upload=11997]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:11:50.467367803 (11h32m24.982470386s) [upload=11997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:57.502219885 (11h33m32.017322462s) [upload=11997]: Done uploading segments... Aug 7 21:12:57.502247705 (11h33m32.017350283s) [upload=11997]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:12:57.635219958 (11h33m32.150322528s) [upload=12020]: Starting upload Aug 7 21:12:57.635291431 (11h33m32.150394007s) [upload=12020]: Done starting upload Aug 7 21:12:57.635412367 (11h33m32.150514934s) [upload=12020]: Uploading segments... Aug 7 21:12:57.635706561 (11h33m32.150809138s) [upload=12020]: Got next segment. Inline: false Aug 7 21:12:57.635807146 (11h33m32.150909713s) [upload=12020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:57.635812366 (11h33m32.150914942s) [upload=12020]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:13:57.598803233 (11h34m32.113905819s) [upload=12020]: Next segment err: context deadline exceeded Aug 7 21:13:57.598926914 (11h34m32.114029476s) [upload=12020]: Done uploading segments... Aug 7 21:13:57.598944574 (11h34m32.114047136s) [upload=12020]: Upload finished. err: context deadline exceeded Aug 7 21:13:57.707893490 (11h34m32.222996072s) [upload=12034]: Starting upload Aug 7 21:13:57.708008457 (11h34m32.223111035s) [upload=12034]: Done starting upload Aug 7 21:13:57.708257239 (11h34m32.223359807s) [upload=12034]: Uploading segments... Aug 7 21:13:57.708628569 (11h34m32.223731149s) [upload=12034]: Got next segment. Inline: false Aug 7 21:13:57.708697917 (11h34m32.2238005s) [upload=12034]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:57.708703428 (11h34m32.223806004s) [upload=12034]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:14:57.677372272 (11h35m32.19247486s) [upload=12034]: Next segment err: context deadline exceeded Aug 7 21:14:57.677532945 (11h35m32.192635511s) [upload=12034]: Done uploading segments... Aug 7 21:14:57.677558723 (11h35m32.192661287s) [upload=12034]: Upload finished. err: context deadline exceeded Duration: 1m0.001687368s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................................X..XX] duration: 30.001593839s FAIL (2025-08-07 21:14:53 UTC) operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== ise=true , address=77.90.31.15:4699 , piece_id=R6HQEA3RK7T3SEDO7XKN3I6C3QQXFUS5NUB7UTE63DCKEFWQOISQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.643818596 (11h33m44.158921172s) [noise=true , address=77.90.31.13:4627 , piece_id=V4YOVGGQNIGEUEMU4KBD4MML5N7COVN3R6CPGHWKLSDIJP72EKNA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644226369 (11h33m44.159328956s) [noise=true , address=45.91.116.6:4973 , piece_id=DMXTLXOFBKBCS4P3NN63HRTVPPKQYEZ43JXAY5SYIIFJ3XUHMIZA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644405055 (11h33m44.159507632s) [noise=true , address=45.91.116.7:4009 , piece_id=HYGXOTEZLK6PX7PJ6ESEIXZDB7VZY5JTDOCBPGNQEMTRLQ4EQUOQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644610987 (11h33m44.159713568s) [noise=true , address=104.36.82.13:4187 , piece_id=Z3NZV4ONUZ2Y5US2FZE4RVVIYFWYVCORTURGKZMRJIMHRSFO2BUA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644815757 (11h33m44.159918339s) [noise=true , address=77.90.31.21:4877 , piece_id=PZYTPZ4FTPYGUWAAYTVJJ52NCMRRKVBKEIWJSVCKJBE25YM7GPYA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644919297 (11h33m44.160021873s) [noise=true , address=104.36.82.12:4151 , piece_id=BH5BGAAHNMU4SHQBJIPIRMTKT43KQXU6NYSU3FYEVDMFM4XTSD6A, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645176061 (11h33m44.160278643s) [noise=true , address=104.36.82.2:4732 , piece_id=JWJKMBNOF33P4GE4JCNPXJKQPLV5ZOO6DOP6FR6OAUX5PVWWHIZQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645224523 (11h33m44.160327213s) [noise=true , address=104.36.82.5:4840 , piece_id=HIVB22AN46HVFKYYA4Z37NCGEIT3PCLVRYUKOHYXBSGD26VAO4HA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645526417 (11h33m44.160628993s) [noise=true , address=104.36.82.13:4185 , piece_id=LQM4CJEBBVRFPPCDCJD56ILSNMNFMU4JN33UHXKPAF6TEYI5QU6A, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645557781 (11h33m44.160660357s) [noise=true , address=45.91.116.13:4154 , piece_id=4HSGHPQBDWNHCX7O2W4EZ7JJT4J6W7IP6ZVOXJA4XNN6EUOSWJUQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645998255 (11h33m44.161100834s) [noise=true , address=77.90.31.10:4518 , piece_id=TQDZ6LPSGO7UM2HZYZJI3B7XEPTR2WARHUVGVNF67X5I3XKXJBPA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.646442419 (11h33m44.161544997s) [noise=true , address=104.36.82.5:4838 , piece_id=JBYOJL63U2WG7FIE6NPKSMRWC3M7AY3AWDVUUSCI7SSXZ6BYTSTA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.646782026 (11h33m44.161884604s) [noise=true , address=45.91.116.14:4189 , piece_id=YUAVAG3QCKZZSZPNGGWJ6TRTA3ANFV6ZQW5MKMJ3Z5E6YPGSF5LQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.647164533 (11h33m44.162267102s) [noise=true , address=45.91.116.10:4083 , piece_id=W6HBOVMCP4OIAGCFYFBXMFPGLE53IUCG44ZGK5TRH6TXIPBZX7BQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.651398712 (11h33m44.16650129s) [noise=true , address=104.36.82.16:4293 , piece_id=IHUFCCV4HR3MGDJ4T4PMHEEEXYGIM26HMMCSOFDX4BTPZ6ER46RA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.745694594 (11h33m44.260797157s) [upload=12024]: Next returned nil segment Aug 7 21:13:09.745713202 (11h33m44.260815787s) [upload=12024]: Waiting for error group managing segments... Aug 7 21:13:09.750303736 (11h33m44.265406298s) [noise=true , address=45.91.116.14:4189 , piece_id=YUAVAG3QCKZZSZPNGGWJ6TRTA3ANFV6ZQW5MKMJ3Z5E6YPGSF5LQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.751785095 (11h33m44.266887664s) [noise=true , address=45.91.116.6:4973 , piece_id=DMXTLXOFBKBCS4P3NN63HRTVPPKQYEZ43JXAY5SYIIFJ3XUHMIZA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.751812119 (11h33m44.266914695s) [noise=true , address=45.91.116.7:4009 , piece_id=HYGXOTEZLK6PX7PJ6ESEIXZDB7VZY5JTDOCBPGNQEMTRLQ4EQUOQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.752237918 (11h33m44.267340495s) [noise=true , address=45.91.116.13:4154 , piece_id=4HSGHPQBDWNHCX7O2W4EZ7JJT4J6W7IP6ZVOXJA4XNN6EUOSWJUQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.752385873 (11h33m44.267488447s) [noise=true , address=77.90.31.10:4518 , piece_id=TQDZ6LPSGO7UM2HZYZJI3B7XEPTR2WARHUVGVNF67X5I3XKXJBPA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.752810939 (11h33m44.267913508s) [noise=true , address=77.90.31.13:4627 , piece_id=V4YOVGGQNIGEUEMU4KBD4MML5N7COVN3R6CPGHWKLSDIJP72EKNA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.753055302 (11h33m44.268157874s) [noise=true , address=77.90.31.15:4699 , piece_id=R6HQEA3RK7T3SEDO7XKN3I6C3QQXFUS5NUB7UTE63DCKEFWQOISQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.753161371 (11h33m44.268263934s) [noise=true , address=45.91.116.10:4083 , piece_id=W6HBOVMCP4OIAGCFYFBXMFPGLE53IUCG44ZGK5TRH6TXIPBZX7BQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.754140685 (11h33m44.269243255s) [noise=true , address=77.90.31.21:4877 , piece_id=PZYTPZ4FTPYGUWAAYTVJJ52NCMRRKVBKEIWJSVCKJBE25YM7GPYA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.757194619 (11h33m44.272297188s) [noise=true , address=104.36.82.13:4185 , piece_id=LQM4CJEBBVRFPPCDCJD56ILSNMNFMU4JN33UHXKPAF6TEYI5QU6A, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.760559383 (11h33m44.275661947s) [noise=true , address=104.36.82.13:4187 , piece_id=Z3NZV4ONUZ2Y5US2FZE4RVVIYFWYVCORTURGKZMRJIMHRSFO2BUA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.761374233 (11h33m44.276476796s) [noise=true , address=104.36.82.12:4151 , piece_id=BH5BGAAHNMU4SHQBJIPIRMTKT43KQXU6NYSU3FYEVDMFM4XTSD6A, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.762971672 (11h33m44.278074239s) [noise=true , address=104.36.82.5:4838 , piece_id=JBYOJL63U2WG7FIE6NPKSMRWC3M7AY3AWDVUUSCI7SSXZ6BYTSTA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.762995306 (11h33m44.278097882s) [seg_pos={0 0}, upload=12024]: Segment reached optimal threshold of 13 pieces. Aug 7 21:13:09.763147697 (11h33m44.278250273s) [noise=true , address=104.36.82.5:4840 , piece_id=HIVB22AN46HVFKYYA4Z37NCGEIT3PCLVRYUKOHYXBSGD26VAO4HA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Aug 7 21:13:09.763240980 (11h33m44.278343557s) [noise=true , address=104.36.82.2:4732 , piece_id=JWJKMBNOF33P4GE4JCNPXJKQPLV5ZOO6DOP6FR6OAUX5PVWWHIZQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 21:13:09.763307126 (11h33m44.278409696s) [noise=true , address=104.36.82.16:4293 , piece_id=IHUFCCV4HR3MGDJ4T4PMHEEEXYGIM26HMMCSOFDX4BTPZ6ER46RA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE): protocol: read tcp 159.223.143.39:39590->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:13:09.763334614 (11h33m44.278437184s) [seg_pos={0 0}, upload=12024]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:13:09.763399512 (11h33m44.278502079s) [upload=12024]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:13:09.763403983 (11h33m44.27850655s) [upload=12024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:09.890775575 (11h33m44.405878162s) [upload=12024]: Done uploading segments... Aug 7 21:13:09.890799811 (11h33m44.4059024s) [upload=12024]: Upload finished. err: <nil> Aug 7 21:13:53.885614800 (11h34m28.400717367s) [upload=12032]: Starting upload Aug 7 21:13:53.885682037 (11h34m28.400784604s) [upload=12032]: Done starting upload Aug 7 21:13:53.885969472 (11h34m28.40107204s) [upload=12032]: Uploading segments... Aug 7 21:13:53.886005928 (11h34m28.40110851s) [upload=12032]: Got next segment. Inline: false Aug 7 21:13:53.886045026 (11h34m28.401147603s) [upload=12032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:53.886049997 (11h34m28.401152564s) [upload=12032]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:14:23.835010686 (11h34m58.350113264s) [upload=12032]: Next segment err: context deadline exceeded Aug 7 21:14:23.835138690 (11h34m58.350241261s) [upload=12032]: Done uploading segments... Aug 7 21:14:23.835156944 (11h34m58.350259514s) [upload=12032]: Upload finished. err: context deadline exceeded Aug 7 21:14:24.005677868 (11h34m58.52078043s) [upload=12045]: Starting upload Aug 7 21:14:24.005744046 (11h34m58.520846622s) [upload=12045]: Done starting upload Aug 7 21:14:24.006013012 (11h34m58.521115575s) [upload=12045]: Uploading segments... Aug 7 21:14:24.006062700 (11h34m58.521165282s) [upload=12045]: Got next segment. Inline: false Aug 7 21:14:24.006089531 (11h34m58.521192094s) [upload=12045]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:14:24.006093389 (11h34m58.521195951s) [upload=12045]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:14:53.975481666 (11h35m28.490584248s) [upload=12045]: Next segment err: context deadline exceeded Aug 7 21:14:53.975596874 (11h35m28.490699444s) [upload=12045]: Done uploading segments... Aug 7 21:14:53.975615592 (11h35m28.490718158s) [upload=12045]: Upload finished. err: context deadline exceeded Duration: 30.001624978s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 30.001195117s FAIL (2025-08-07 21:14:53 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001214932s core uplink us1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 3 out of 60 is failed (threshold=3) [.........................................................XXX] duration: 1m0.001868114s FAIL (2025-08-07 21:14:52 UTC) operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001883703s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00054973s FAIL (2025-08-07 21:14:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.000568803s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................................X..X] duration: 30.001492899s FAIL (2025-08-07 21:14:23 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 8303s) [upload=12004]: Upload finished. err: <nil> Aug 7 21:13:09.563610634 (11h33m44.078713211s) [upload=12024]: Starting upload Aug 7 21:13:09.563668943 (11h33m44.078771523s) [upload=12024]: Done starting upload Aug 7 21:13:09.563772942 (11h33m44.078875528s) [upload=12024]: Uploading segments... Aug 7 21:13:09.563954698 (11h33m44.079057269s) [upload=12024]: Got next segment. Inline: false Aug 7 21:13:09.563993794 (11h33m44.079096371s) [upload=12024]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:09.563998229 (11h33m44.079100805s) [upload=12024]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:13:09.643708872 (11h33m44.158811458s) [seg_pos={0 0}, upload=12024]: Begin upload segment... Aug 7 21:13:09.643791979 (11h33m44.158894562s) [seg_pos={0 0}, upload=12024]: Done begin upload segment. Aug 7 21:13:09.643802576 (11h33m44.15890514s) [noise=true , address=77.90.31.15:4699 , piece_id=R6HQEA3RK7T3SEDO7XKN3I6C3QQXFUS5NUB7UTE63DCKEFWQOISQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.643818596 (11h33m44.158921172s) [noise=true , address=77.90.31.13:4627 , piece_id=V4YOVGGQNIGEUEMU4KBD4MML5N7COVN3R6CPGHWKLSDIJP72EKNA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644226369 (11h33m44.159328956s) [noise=true , address=45.91.116.6:4973 , piece_id=DMXTLXOFBKBCS4P3NN63HRTVPPKQYEZ43JXAY5SYIIFJ3XUHMIZA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644405055 (11h33m44.159507632s) [noise=true , address=45.91.116.7:4009 , piece_id=HYGXOTEZLK6PX7PJ6ESEIXZDB7VZY5JTDOCBPGNQEMTRLQ4EQUOQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644610987 (11h33m44.159713568s) [noise=true , address=104.36.82.13:4187 , piece_id=Z3NZV4ONUZ2Y5US2FZE4RVVIYFWYVCORTURGKZMRJIMHRSFO2BUA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644815757 (11h33m44.159918339s) [noise=true , address=77.90.31.21:4877 , piece_id=PZYTPZ4FTPYGUWAAYTVJJ52NCMRRKVBKEIWJSVCKJBE25YM7GPYA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.644919297 (11h33m44.160021873s) [noise=true , address=104.36.82.12:4151 , piece_id=BH5BGAAHNMU4SHQBJIPIRMTKT43KQXU6NYSU3FYEVDMFM4XTSD6A, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645176061 (11h33m44.160278643s) [noise=true , address=104.36.82.2:4732 , piece_id=JWJKMBNOF33P4GE4JCNPXJKQPLV5ZOO6DOP6FR6OAUX5PVWWHIZQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645224523 (11h33m44.160327213s) [noise=true , address=104.36.82.5:4840 , piece_id=HIVB22AN46HVFKYYA4Z37NCGEIT3PCLVRYUKOHYXBSGD26VAO4HA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645526417 (11h33m44.160628993s) [noise=true , address=104.36.82.13:4185 , piece_id=LQM4CJEBBVRFPPCDCJD56ILSNMNFMU4JN33UHXKPAF6TEYI5QU6A, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645557781 (11h33m44.160660357s) [noise=true , address=45.91.116.13:4154 , piece_id=4HSGHPQBDWNHCX7O2W4EZ7JJT4J6W7IP6ZVOXJA4XNN6EUOSWJUQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.645998255 (11h33m44.161100834s) [noise=true , address=77.90.31.10:4518 , piece_id=TQDZ6LPSGO7UM2HZYZJI3B7XEPTR2WARHUVGVNF67X5I3XKXJBPA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.646442419 (11h33m44.161544997s) [noise=true , address=104.36.82.5:4838 , piece_id=JBYOJL63U2WG7FIE6NPKSMRWC3M7AY3AWDVUUSCI7SSXZ6BYTSTA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.646782026 (11h33m44.161884604s) [noise=true , address=45.91.116.14:4189 , piece_id=YUAVAG3QCKZZSZPNGGWJ6TRTA3ANFV6ZQW5MKMJ3Z5E6YPGSF5LQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.647164533 (11h33m44.162267102s) [noise=true , address=45.91.116.10:4083 , piece_id=W6HBOVMCP4OIAGCFYFBXMFPGLE53IUCG44ZGK5TRH6TXIPBZX7BQ, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.651398712 (11h33m44.16650129s) [noise=true , address=104.36.82.16:4293 , piece_id=IHUFCCV4HR3MGDJ4T4PMHEEEXYGIM26HMMCSOFDX4BTPZ6ER46RA, seg_pos={0 0}, upload=12024]: Uploading piece... Aug 7 21:13:09.745694594 (11h33m44.260797157s) [upload=12024]: Next returned nil segment Aug 7 21:13:09.745713202 (11h33m44.260815787s) [upload=12024]: Waiting for error group managing segments... Aug 7 21:13:09.750303736 (11h33m44.265406298s) [noise=true , address=45.91.116.14:4189 , piece_id=YUAVAG3QCKZZSZPNGGWJ6TRTA3ANFV6ZQW5MKMJ3Z5E6YPGSF5LQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.751785095 (11h33m44.266887664s) [noise=true , address=45.91.116.6:4973 , piece_id=DMXTLXOFBKBCS4P3NN63HRTVPPKQYEZ43JXAY5SYIIFJ3XUHMIZA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.751812119 (11h33m44.266914695s) [noise=true , address=45.91.116.7:4009 , piece_id=HYGXOTEZLK6PX7PJ6ESEIXZDB7VZY5JTDOCBPGNQEMTRLQ4EQUOQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.752237918 (11h33m44.267340495s) [noise=true , address=45.91.116.13:4154 , piece_id=4HSGHPQBDWNHCX7O2W4EZ7JJT4J6W7IP6ZVOXJA4XNN6EUOSWJUQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.752385873 (11h33m44.267488447s) [noise=true , address=77.90.31.10:4518 , piece_id=TQDZ6LPSGO7UM2HZYZJI3B7XEPTR2WARHUVGVNF67X5I3XKXJBPA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.752810939 (11h33m44.267913508s) [noise=true , address=77.90.31.13:4627 , piece_id=V4YOVGGQNIGEUEMU4KBD4MML5N7COVN3R6CPGHWKLSDIJP72EKNA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.753055302 (11h33m44.268157874s) [noise=true , address=77.90.31.15:4699 , piece_id=R6HQEA3RK7T3SEDO7XKN3I6C3QQXFUS5NUB7UTE63DCKEFWQOISQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.753161371 (11h33m44.268263934s) [noise=true , address=45.91.116.10:4083 , piece_id=W6HBOVMCP4OIAGCFYFBXMFPGLE53IUCG44ZGK5TRH6TXIPBZX7BQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.754140685 (11h33m44.269243255s) [noise=true , address=77.90.31.21:4877 , piece_id=PZYTPZ4FTPYGUWAAYTVJJ52NCMRRKVBKEIWJSVCKJBE25YM7GPYA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.757194619 (11h33m44.272297188s) [noise=true , address=104.36.82.13:4185 , piece_id=LQM4CJEBBVRFPPCDCJD56ILSNMNFMU4JN33UHXKPAF6TEYI5QU6A, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.760559383 (11h33m44.275661947s) [noise=true , address=104.36.82.13:4187 , piece_id=Z3NZV4ONUZ2Y5US2FZE4RVVIYFWYVCORTURGKZMRJIMHRSFO2BUA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.761374233 (11h33m44.276476796s) [noise=true , address=104.36.82.12:4151 , piece_id=BH5BGAAHNMU4SHQBJIPIRMTKT43KQXU6NYSU3FYEVDMFM4XTSD6A, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.762971672 (11h33m44.278074239s) [noise=true , address=104.36.82.5:4838 , piece_id=JBYOJL63U2WG7FIE6NPKSMRWC3M7AY3AWDVUUSCI7SSXZ6BYTSTA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: <nil> Aug 7 21:13:09.762995306 (11h33m44.278097882s) [seg_pos={0 0}, upload=12024]: Segment reached optimal threshold of 13 pieces. Aug 7 21:13:09.763147697 (11h33m44.278250273s) [noise=true , address=104.36.82.5:4840 , piece_id=HIVB22AN46HVFKYYA4Z37NCGEIT3PCLVRYUKOHYXBSGD26VAO4HA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12crcXpNe9NgeXTsUpooLSBgrSUFbRxbSbanLa39w2Hr5mGFww): protocol: expected piece hash; context canceled; EOF Aug 7 21:13:09.763240980 (11h33m44.278343557s) [noise=true , address=104.36.82.2:4732 , piece_id=JWJKMBNOF33P4GE4JCNPXJKQPLV5ZOO6DOP6FR6OAUX5PVWWHIZQ, seg_pos={0 0}, upload=12024]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12KuoS4Fh3YKpoEgZuxcDLE1e1KZENgrLTqR9T5yCWonHiVfaXE): protocol: expected piece hash; context canceled; EOF Aug 7 21:13:09.763307126 (11h33m44.278409696s) [noise=true , address=104.36.82.16:4293 , piece_id=IHUFCCV4HR3MGDJ4T4PMHEEEXYGIM26HMMCSOFDX4BTPZ6ER46RA, seg_pos={0 0}, upload=12024]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12jsNwKfNEjPG9fmLdvdJwMYPHeh5w3KtWA1MsXZ9Ns8QBpVYbE): protocol: read tcp 159.223.143.39:39590->104.36.82.16:4293: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 21:13:09.763334614 (11h33m44.278437184s) [seg_pos={0 0}, upload=12024]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:13:09.763399512 (11h33m44.278502079s) [upload=12024]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:13:09.763403983 (11h33m44.27850655s) [upload=12024]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:09.890775575 (11h33m44.405878162s) [upload=12024]: Done uploading segments... Aug 7 21:13:09.890799811 (11h33m44.4059024s) [upload=12024]: Upload finished. err: <nil> Aug 7 21:13:53.885614800 (11h34m28.400717367s) [upload=12032]: Starting upload Aug 7 21:13:53.885682037 (11h34m28.400784604s) [upload=12032]: Done starting upload Aug 7 21:13:53.885969472 (11h34m28.40107204s) [upload=12032]: Uploading segments... Aug 7 21:13:53.886005928 (11h34m28.40110851s) [upload=12032]: Got next segment. Inline: false Aug 7 21:13:53.886045026 (11h34m28.401147603s) [upload=12032]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:53.886049997 (11h34m28.401152564s) [upload=12032]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:14:23.835010686 (11h34m58.350113264s) [upload=12032]: Next segment err: context deadline exceeded Aug 7 21:14:23.835138690 (11h34m58.350241261s) [upload=12032]: Done uploading segments... Aug 7 21:14:23.835156944 (11h34m58.350259514s) [upload=12032]: Upload finished. err: context deadline exceeded Duration: 30.001546055s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001233355s FAIL (2025-08-07 21:14:18 UTC) orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded Duration: 30.001253975s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 30.001020584s FAIL (2025-08-07 21:14:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Aug 7 21:03:25.430928214 (11h23m59.94603079s) [upload=11864]: Upload finished. err: <nil> Aug 7 21:04:22.468517346 (11h24m56.983619925s) [upload=11880]: Starting upload Aug 7 21:04:22.468580992 (11h24m56.983683577s) [upload=11880]: Done starting upload Aug 7 21:04:22.468653301 (11h24m56.983755878s) [upload=11880]: Uploading segments... Aug 7 21:04:22.468690982 (11h24m56.983793567s) [upload=11880]: Got next segment. Inline: true Aug 7 21:04:22.468697356 (11h24m56.983799935s) [upload=11880]: Waiting for error group managing segments... Aug 7 21:04:22.468737922 (11h24m56.983840498s) [upload=11880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:04:22.468742663 (11h24m56.983845239s) [upload=11880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:04:22.468745917 (11h24m56.983848494s) [upload=11880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:04:22.543627781 (11h24m57.058730357s) [upload=11880]: Done uploading segments... Aug 7 21:04:22.543645123 (11h24m57.0587477s) [upload=11880]: Upload finished. err: <nil> Aug 7 21:05:35.662296889 (11h26m10.177399488s) [upload=11901]: Starting upload Aug 7 21:05:35.662378631 (11h26m10.177481207s) [upload=11901]: Done starting upload Aug 7 21:05:35.662453437 (11h26m10.177556014s) [upload=11901]: Uploading segments... Aug 7 21:05:35.662492371 (11h26m10.177594955s) [upload=11901]: Got next segment. Inline: true Aug 7 21:05:35.662496846 (11h26m10.177599422s) [upload=11901]: Waiting for error group managing segments... Aug 7 21:05:35.662551335 (11h26m10.177653912s) [upload=11901]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:05:35.662556009 (11h26m10.177658586s) [upload=11901]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:05:35.662559422 (11h26m10.177661998s) [upload=11901]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:05:35.740749306 (11h26m10.255851883s) [upload=11901]: Done uploading segments... Aug 7 21:05:35.740769835 (11h26m10.25587241s) [upload=11901]: Upload finished. err: <nil> Aug 7 21:06:46.230520674 (11h27m20.74562325s) [upload=11919]: Starting upload Aug 7 21:06:46.230607961 (11h27m20.745710539s) [upload=11919]: Done starting upload Aug 7 21:06:46.230686288 (11h27m20.745788854s) [upload=11919]: Uploading segments... Aug 7 21:06:46.230742531 (11h27m20.7458459s) [upload=11919]: Got next segment. Inline: true Aug 7 21:06:46.230751102 (11h27m20.745853666s) [upload=11919]: Waiting for error group managing segments... Aug 7 21:06:46.230820637 (11h27m20.745923214s) [upload=11919]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:06:46.230826241 (11h27m20.74592881s) [upload=11919]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:06:46.230830757 (11h27m20.74593334s) [upload=11919]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:06:46.307287404 (11h27m20.822389968s) [upload=11919]: Done uploading segments... Aug 7 21:06:46.307304611 (11h27m20.822407182s) [upload=11919]: Upload finished. err: <nil> Aug 7 21:08:01.094338764 (11h28m35.609441348s) [upload=11937]: Starting upload Aug 7 21:08:01.094439624 (11h28m35.609542203s) [upload=11937]: Done starting upload Aug 7 21:08:01.094530817 (11h28m35.609633396s) [upload=11937]: Uploading segments... Aug 7 21:08:01.094614230 (11h28m35.609716816s) [upload=11937]: Got next segment. Inline: true Aug 7 21:08:01.094621916 (11h28m35.609724497s) [upload=11937]: Waiting for error group managing segments... Aug 7 21:08:01.094683972 (11h28m35.609786552s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:08:01.094691937 (11h28m35.609794517s) [upload=11937]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:01.094697155 (11h28m35.609799732s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:08:01.161630100 (11h28m35.676732674s) [upload=11937]: Done uploading segments... Aug 7 21:08:01.161650889 (11h28m35.676753468s) [upload=11937]: Upload finished. err: <nil> Aug 7 21:09:09.556774580 (11h29m44.071877161s) [upload=11956]: Starting upload Aug 7 21:09:09.556869520 (11h29m44.071972101s) [upload=11956]: Done starting upload Aug 7 21:09:09.556938280 (11h29m44.072040846s) [upload=11956]: Uploading segments... Aug 7 21:09:09.557010711 (11h29m44.072113296s) [upload=11956]: Got next segment. Inline: true Aug 7 21:09:09.557016786 (11h29m44.072119352s) [upload=11956]: Waiting for error group managing segments... Aug 7 21:09:09.557085460 (11h29m44.072188039s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:09.557091284 (11h29m44.07219386s) [upload=11956]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:09.557094925 (11h29m44.072197502s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:09.747686849 (11h29m44.262789432s) [upload=11956]: Done uploading segments... Aug 7 21:09:09.747707829 (11h29m44.262810399s) [upload=11956]: Upload finished. err: <nil> Aug 7 21:09:59.461356278 (11h30m33.976458859s) [upload=11970]: Starting upload Aug 7 21:09:59.461514228 (11h30m33.976616814s) [upload=11970]: Done starting upload Aug 7 21:09:59.461657967 (11h30m33.976760542s) [upload=11970]: Uploading segments... Aug 7 21:09:59.461728003 (11h30m33.976830589s) [upload=11970]: Got next segment. Inline: true Aug 7 21:09:59.461733779 (11h30m33.976836356s) [upload=11970]: Waiting for error group managing segments... Aug 7 21:09:59.461777635 (11h30m33.976880202s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:59.461783114 (11h30m33.97688569s) [upload=11970]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:59.461787951 (11h30m33.976890529s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:59.731460482 (11h30m34.246563058s) [upload=11970]: Done uploading segments... Aug 7 21:09:59.731478076 (11h30m34.246580652s) [upload=11970]: Upload finished. err: <nil> Aug 7 21:10:42.945656363 (11h31m17.460758936s) [upload=11982]: Starting upload Aug 7 21:10:42.945741284 (11h31m17.460843863s) [upload=11982]: Done starting upload Aug 7 21:10:42.945850852 (11h31m17.46095342s) [upload=11982]: Uploading segments... Aug 7 21:10:42.945892389 (11h31m17.460994975s) [upload=11982]: Got next segment. Inline: true Aug 7 21:10:42.945897243 (11h31m17.460999819s) [upload=11982]: Waiting for error group managing segments... Aug 7 21:10:42.945957561 (11h31m17.461060137s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:42.945962699 (11h31m17.461065276s) [upload=11982]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:42.945965846 (11h31m17.461068421s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:43.061691785 (11h31m17.576794373s) [upload=11982]: Done uploading segments... Aug 7 21:10:43.061710851 (11h31m17.576813425s) [upload=11982]: Upload finished. err: <nil> Aug 7 21:11:55.646673634 (11h32m30.161776203s) [upload=12003]: Starting upload Aug 7 21:11:55.646725223 (11h32m30.161827806s) [upload=12003]: Done starting upload Aug 7 21:11:55.646793999 (11h32m30.161896566s) [upload=12003]: Uploading segments... Aug 7 21:11:55.646853254 (11h32m30.161955836s) [upload=12003]: Got next segment. Inline: true Aug 7 21:11:55.646858259 (11h32m30.161960835s) [upload=12003]: Waiting for error group managing segments... Aug 7 21:11:55.646908687 (11h32m30.162011263s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:55.646914002 (11h32m30.162016583s) [upload=12003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:55.646918834 (11h32m30.162021413s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:55.718218370 (11h32m30.233320937s) [upload=12003]: Done uploading segments... Aug 7 21:11:55.718234789 (11h32m30.233337359s) [upload=12003]: Upload finished. err: <nil> Aug 7 21:12:27.468174562 (11h33m1.983277139s) [upload=12010]: Starting upload Aug 7 21:12:27.468269218 (11h33m1.983371788s) [upload=12010]: Done starting upload Aug 7 21:12:27.468432459 (11h33m1.983535027s) [upload=12010]: Uploading segments... Aug 7 21:12:27.468502812 (11h33m1.983605391s) [upload=12010]: Got next segment. Inline: true Aug 7 21:12:27.468509793 (11h33m1.983612369s) [upload=12010]: Waiting for error group managing segments... Aug 7 21:12:27.468577961 (11h33m1.983680537s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:27.468583494 (11h33m1.98368607s) [upload=12010]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:27.468587033 (11h33m1.983689609s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:27.713163795 (11h33m2.228266382s) [upload=12010]: Done uploading segments... Aug 7 21:12:27.713184263 (11h33m2.228286844s) [upload=12010]: Upload finished. err: <nil> Aug 7 21:13:00.260488755 (11h33m34.775591337s) [upload=12021]: Starting upload Aug 7 21:13:00.260589735 (11h33m34.775692306s) [upload=12021]: Done starting upload Aug 7 21:13:00.260688806 (11h33m34.775791377s) [upload=12021]: Uploading segments... Aug 7 21:13:00.260755956 (11h33m34.775858537s) [upload=12021]: Got next segment. Inline: true Aug 7 21:13:00.260760943 (11h33m34.775863519s) [upload=12021]: Waiting for error group managing segments... Aug 7 21:13:00.260825909 (11h33m34.775928474s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:00.260831124 (11h33m34.775933703s) [upload=12021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:00.260834322 (11h33m34.7759369s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:30.231998317 (11h34m4.747100894s) [upload=12021]: Done uploading segments... Aug 7 21:13:30.232017085 (11h34m4.74711966s) [upload=12021]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.001042363s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.000863308s FAIL (2025-08-07 21:13:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== OUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.870753785 (11h32m24.385856367s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.871782032 (11h32m24.386884617s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.872757979 (11h32m24.387860565s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.873402251 (11h32m24.388504835s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.874007875 (11h32m24.389110457s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.875394772 (11h32m24.390497359s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.875816032 (11h32m24.39091862s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.876209598 (11h32m24.391312188s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.876649290 (11h32m24.391751878s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877055376 (11h32m24.392157964s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877448982 (11h32m24.39255157s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877851712 (11h32m24.3929543s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878256545 (11h32m24.393359132s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878707848 (11h32m24.393810434s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879171370 (11h32m24.39427396s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879563499 (11h32m24.394666085s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879928199 (11h32m24.395030797s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.974975266 (11h32m24.490077832s) [upload=11997]: Next returned nil segment Aug 7 21:11:49.974994144 (11h32m24.49009672s) [upload=11997]: Waiting for error group managing segments... Aug 7 21:11:49.988542190 (11h32m24.50364476s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.995910724 (11h32m24.511013304s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.996610690 (11h32m24.511713266s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.999701015 (11h32m24.514803592s) [noise=true , address=104.36.82.61:4405 , piece_id=IOUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.008965761 (11h32m24.524068325s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.017145206 (11h32m24.532247782s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.022781027 (11h32m24.537883606s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.023398509 (11h32m24.53850109s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.043528291 (11h32m24.558630869s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.046437033 (11h32m24.561539599s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.087365961 (11h32m24.602468531s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.160388869 (11h32m24.675491445s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.301621081 (11h32m24.816723645s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466287316 (11h32m24.981389887s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466310392 (11h32m24.981412969s) [seg_pos={0 0}, upload=11997]: Segment reached optimal threshold of 14 pieces. Aug 7 21:11:50.466545670 (11h32m24.981648233s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.466997931 (11h32m24.982100496s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467162262 (11h32m24.982264825s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467246223 (11h32m24.982348803s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467281805 (11h32m24.982384369s) [seg_pos={0 0}, upload=11997]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:11:50.467362207 (11h32m24.982464787s) [upload=11997]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:11:50.467367803 (11h32m24.982470386s) [upload=11997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:57.502219885 (11h33m32.017322462s) [upload=11997]: Done uploading segments... Aug 7 21:12:57.502247705 (11h33m32.017350283s) [upload=11997]: Upload finished. err: metaclient: context deadline exceeded Aug 7 21:12:57.635219958 (11h33m32.150322528s) [upload=12020]: Starting upload Aug 7 21:12:57.635291431 (11h33m32.150394007s) [upload=12020]: Done starting upload Aug 7 21:12:57.635412367 (11h33m32.150514934s) [upload=12020]: Uploading segments... Aug 7 21:12:57.635706561 (11h33m32.150809138s) [upload=12020]: Got next segment. Inline: false Aug 7 21:12:57.635807146 (11h33m32.150909713s) [upload=12020]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:57.635812366 (11h33m32.150914942s) [upload=12020]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:13:57.598803233 (11h34m32.113905819s) [upload=12020]: Next segment err: context deadline exceeded Aug 7 21:13:57.598926914 (11h34m32.114029476s) [upload=12020]: Done uploading segments... Aug 7 21:13:57.598944574 (11h34m32.114047136s) [upload=12020]: Upload finished. err: context deadline exceeded Duration: 1m0.000880243s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 2 out of 60 is failed (threshold=3) [..........................................................XX] duration: 1m0.001220813s FAIL (2025-08-07 21:13:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001238603s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 257.709529ms FAIL (2025-08-07 21:13:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 257.729703ms edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.000999466s FAIL (2025-08-07 21:13:30 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ... Aug 7 21:03:25.430928214 (11h23m59.94603079s) [upload=11864]: Upload finished. err: <nil> Aug 7 21:04:22.468517346 (11h24m56.983619925s) [upload=11880]: Starting upload Aug 7 21:04:22.468580992 (11h24m56.983683577s) [upload=11880]: Done starting upload Aug 7 21:04:22.468653301 (11h24m56.983755878s) [upload=11880]: Uploading segments... Aug 7 21:04:22.468690982 (11h24m56.983793567s) [upload=11880]: Got next segment. Inline: true Aug 7 21:04:22.468697356 (11h24m56.983799935s) [upload=11880]: Waiting for error group managing segments... Aug 7 21:04:22.468737922 (11h24m56.983840498s) [upload=11880]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:04:22.468742663 (11h24m56.983845239s) [upload=11880]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:04:22.468745917 (11h24m56.983848494s) [upload=11880]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:04:22.543627781 (11h24m57.058730357s) [upload=11880]: Done uploading segments... Aug 7 21:04:22.543645123 (11h24m57.0587477s) [upload=11880]: Upload finished. err: <nil> Aug 7 21:05:35.662296889 (11h26m10.177399488s) [upload=11901]: Starting upload Aug 7 21:05:35.662378631 (11h26m10.177481207s) [upload=11901]: Done starting upload Aug 7 21:05:35.662453437 (11h26m10.177556014s) [upload=11901]: Uploading segments... Aug 7 21:05:35.662492371 (11h26m10.177594955s) [upload=11901]: Got next segment. Inline: true Aug 7 21:05:35.662496846 (11h26m10.177599422s) [upload=11901]: Waiting for error group managing segments... Aug 7 21:05:35.662551335 (11h26m10.177653912s) [upload=11901]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:05:35.662556009 (11h26m10.177658586s) [upload=11901]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:05:35.662559422 (11h26m10.177661998s) [upload=11901]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:05:35.740749306 (11h26m10.255851883s) [upload=11901]: Done uploading segments... Aug 7 21:05:35.740769835 (11h26m10.25587241s) [upload=11901]: Upload finished. err: <nil> Aug 7 21:06:46.230520674 (11h27m20.74562325s) [upload=11919]: Starting upload Aug 7 21:06:46.230607961 (11h27m20.745710539s) [upload=11919]: Done starting upload Aug 7 21:06:46.230686288 (11h27m20.745788854s) [upload=11919]: Uploading segments... Aug 7 21:06:46.230742531 (11h27m20.7458459s) [upload=11919]: Got next segment. Inline: true Aug 7 21:06:46.230751102 (11h27m20.745853666s) [upload=11919]: Waiting for error group managing segments... Aug 7 21:06:46.230820637 (11h27m20.745923214s) [upload=11919]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:06:46.230826241 (11h27m20.74592881s) [upload=11919]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:06:46.230830757 (11h27m20.74593334s) [upload=11919]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:06:46.307287404 (11h27m20.822389968s) [upload=11919]: Done uploading segments... Aug 7 21:06:46.307304611 (11h27m20.822407182s) [upload=11919]: Upload finished. err: <nil> Aug 7 21:08:01.094338764 (11h28m35.609441348s) [upload=11937]: Starting upload Aug 7 21:08:01.094439624 (11h28m35.609542203s) [upload=11937]: Done starting upload Aug 7 21:08:01.094530817 (11h28m35.609633396s) [upload=11937]: Uploading segments... Aug 7 21:08:01.094614230 (11h28m35.609716816s) [upload=11937]: Got next segment. Inline: true Aug 7 21:08:01.094621916 (11h28m35.609724497s) [upload=11937]: Waiting for error group managing segments... Aug 7 21:08:01.094683972 (11h28m35.609786552s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:08:01.094691937 (11h28m35.609794517s) [upload=11937]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:08:01.094697155 (11h28m35.609799732s) [upload=11937]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:08:01.161630100 (11h28m35.676732674s) [upload=11937]: Done uploading segments... Aug 7 21:08:01.161650889 (11h28m35.676753468s) [upload=11937]: Upload finished. err: <nil> Aug 7 21:09:09.556774580 (11h29m44.071877161s) [upload=11956]: Starting upload Aug 7 21:09:09.556869520 (11h29m44.071972101s) [upload=11956]: Done starting upload Aug 7 21:09:09.556938280 (11h29m44.072040846s) [upload=11956]: Uploading segments... Aug 7 21:09:09.557010711 (11h29m44.072113296s) [upload=11956]: Got next segment. Inline: true Aug 7 21:09:09.557016786 (11h29m44.072119352s) [upload=11956]: Waiting for error group managing segments... Aug 7 21:09:09.557085460 (11h29m44.072188039s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:09.557091284 (11h29m44.07219386s) [upload=11956]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:09.557094925 (11h29m44.072197502s) [upload=11956]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:09.747686849 (11h29m44.262789432s) [upload=11956]: Done uploading segments... Aug 7 21:09:09.747707829 (11h29m44.262810399s) [upload=11956]: Upload finished. err: <nil> Aug 7 21:09:59.461356278 (11h30m33.976458859s) [upload=11970]: Starting upload Aug 7 21:09:59.461514228 (11h30m33.976616814s) [upload=11970]: Done starting upload Aug 7 21:09:59.461657967 (11h30m33.976760542s) [upload=11970]: Uploading segments... Aug 7 21:09:59.461728003 (11h30m33.976830589s) [upload=11970]: Got next segment. Inline: true Aug 7 21:09:59.461733779 (11h30m33.976836356s) [upload=11970]: Waiting for error group managing segments... Aug 7 21:09:59.461777635 (11h30m33.976880202s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:09:59.461783114 (11h30m33.97688569s) [upload=11970]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:09:59.461787951 (11h30m33.976890529s) [upload=11970]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:09:59.731460482 (11h30m34.246563058s) [upload=11970]: Done uploading segments... Aug 7 21:09:59.731478076 (11h30m34.246580652s) [upload=11970]: Upload finished. err: <nil> Aug 7 21:10:42.945656363 (11h31m17.460758936s) [upload=11982]: Starting upload Aug 7 21:10:42.945741284 (11h31m17.460843863s) [upload=11982]: Done starting upload Aug 7 21:10:42.945850852 (11h31m17.46095342s) [upload=11982]: Uploading segments... Aug 7 21:10:42.945892389 (11h31m17.460994975s) [upload=11982]: Got next segment. Inline: true Aug 7 21:10:42.945897243 (11h31m17.460999819s) [upload=11982]: Waiting for error group managing segments... Aug 7 21:10:42.945957561 (11h31m17.461060137s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:42.945962699 (11h31m17.461065276s) [upload=11982]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:10:42.945965846 (11h31m17.461068421s) [upload=11982]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:43.061691785 (11h31m17.576794373s) [upload=11982]: Done uploading segments... Aug 7 21:10:43.061710851 (11h31m17.576813425s) [upload=11982]: Upload finished. err: <nil> Aug 7 21:11:55.646673634 (11h32m30.161776203s) [upload=12003]: Starting upload Aug 7 21:11:55.646725223 (11h32m30.161827806s) [upload=12003]: Done starting upload Aug 7 21:11:55.646793999 (11h32m30.161896566s) [upload=12003]: Uploading segments... Aug 7 21:11:55.646853254 (11h32m30.161955836s) [upload=12003]: Got next segment. Inline: true Aug 7 21:11:55.646858259 (11h32m30.161960835s) [upload=12003]: Waiting for error group managing segments... Aug 7 21:11:55.646908687 (11h32m30.162011263s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:55.646914002 (11h32m30.162016583s) [upload=12003]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:11:55.646918834 (11h32m30.162021413s) [upload=12003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:11:55.718218370 (11h32m30.233320937s) [upload=12003]: Done uploading segments... Aug 7 21:11:55.718234789 (11h32m30.233337359s) [upload=12003]: Upload finished. err: <nil> Aug 7 21:12:27.468174562 (11h33m1.983277139s) [upload=12010]: Starting upload Aug 7 21:12:27.468269218 (11h33m1.983371788s) [upload=12010]: Done starting upload Aug 7 21:12:27.468432459 (11h33m1.983535027s) [upload=12010]: Uploading segments... Aug 7 21:12:27.468502812 (11h33m1.983605391s) [upload=12010]: Got next segment. Inline: true Aug 7 21:12:27.468509793 (11h33m1.983612369s) [upload=12010]: Waiting for error group managing segments... Aug 7 21:12:27.468577961 (11h33m1.983680537s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:12:27.468583494 (11h33m1.98368607s) [upload=12010]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:12:27.468587033 (11h33m1.983689609s) [upload=12010]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:27.713163795 (11h33m2.228266382s) [upload=12010]: Done uploading segments... Aug 7 21:12:27.713184263 (11h33m2.228286844s) [upload=12010]: Upload finished. err: <nil> Aug 7 21:13:00.260488755 (11h33m34.775591337s) [upload=12021]: Starting upload Aug 7 21:13:00.260589735 (11h33m34.775692306s) [upload=12021]: Done starting upload Aug 7 21:13:00.260688806 (11h33m34.775791377s) [upload=12021]: Uploading segments... Aug 7 21:13:00.260755956 (11h33m34.775858537s) [upload=12021]: Got next segment. Inline: true Aug 7 21:13:00.260760943 (11h33m34.775863519s) [upload=12021]: Waiting for error group managing segments... Aug 7 21:13:00.260825909 (11h33m34.775928474s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:13:00.260831124 (11h33m34.775933703s) [upload=12021]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 7 21:13:00.260834322 (11h33m34.7759369s) [upload=12021]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:13:30.231998317 (11h34m4.747100894s) [upload=12021]: Done uploading segments... Aug 7 21:13:30.232017085 (11h34m4.74711966s) [upload=12021]: Upload finished. err: metaclient: context deadline exceeded Duration: 30.001017018s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 576.88325ms FAIL (2025-08-07 21:13:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 1h30m28.790930063s) [upload=11968]: Done uploading segments... Aug 7 21:09:54.275843505 (11h30m28.790946076s) [upload=11968]: Upload finished. err: <nil> Aug 7 21:10:51.587678236 (11h31m26.102780816s) [upload=11985]: Starting upload Aug 7 21:10:51.587761818 (11h31m26.102864396s) [upload=11985]: Done starting upload Aug 7 21:10:51.587860672 (11h31m26.102963249s) [upload=11985]: Uploading segments... Aug 7 21:10:51.588239458 (11h31m26.103342048s) [upload=11985]: Got next segment. Inline: false Aug 7 21:10:51.588360567 (11h31m26.103463145s) [upload=11985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:51.588368110 (11h31m26.103470696s) [upload=11985]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:10:51.618544212 (11h31m26.133646778s) [seg_pos={0 0}, upload=11985]: Begin upload segment... Aug 7 21:10:51.618639398 (11h31m26.13374198s) [seg_pos={0 0}, upload=11985]: Done begin upload segment. Aug 7 21:10:51.618674269 (11h31m26.133776837s) [noise=true , address=104.36.82.6:4875 , piece_id=3FWNPXWQCC5OBYRKLVGZAILAJK3GSSMJADETENEVQ55OBJXAUUUQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619144969 (11h31m26.13424755s) [noise=true , address=45.91.116.9:4261 , piece_id=LCBENB7EIEAC2VGCXE6OMJNS6MMN5Z3GWVZV2OEMJGK7YY3QNDRQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619158689 (11h31m26.134261265s) [noise=true , address=77.90.31.14:4663 , piece_id=EAM2REHEFLGPXKT3VD4RR45YNINBAZ25XPHPGOK7I65MU4DRHRLA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619516851 (11h31m26.134619428s) [noise=true , address=104.36.82.15:4258 , piece_id=I3ENXKIHBFN5AR6S5OGGXN5W3L6EWTLPDP65CKEUBLKXBPFWFODA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619793570 (11h31m26.134896149s) [noise=true , address=104.36.82.11:4115 , piece_id=3FGKWCTGGHLRIJGP3IQLN2IARUWGVWLTAV7SP74ZIGNFOIP4VPBA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619978882 (11h31m26.135081465s) [noise=true , address=77.90.31.16:4734 , piece_id=35VEIKUWCTXWBD3UHPWWTKYN4F2SGDXBRPPFN7NKVX5HMJKJZ7YA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620436377 (11h31m26.135538954s) [noise=true , address=77.90.31.10:4517 , piece_id=3SKPOCWCX5QCXIRA7OXFN2RRV26632KLTKMFYFO4UBDN4OVENMDA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620692287 (11h31m26.135794882s) [noise=true , address=45.91.116.13:4154 , piece_id=C5EDLMTKRNJGFMQDMVOJKHBDJ2X6LSNMN7BQABZXNPLRTIBD2WWQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620967442 (11h31m26.136070021s) [noise=true , address=45.91.116.4:4938 , piece_id=KUDVK252OB6OEXANHLYKAOX34EJ6X45EXGHKY6HJKTFHEHZOIT7Q, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.621052086 (11h31m26.136154673s) [noise=true , address=45.91.116.5:4297 , piece_id=WOS2UDZJLR5RNVS7NVJGS5ONSYHI5MAS3ZU3SWVAX6GDAEYMASUA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.621397153 (11h31m26.136499739s) [noise=true , address=104.36.82.12:4151 , piece_id=DBMQLDV6IP42H3HTHE2OSEA2HYDLHLB7ZMMDZ3Y6EFEJMBKQWLIA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.622422358 (11h31m26.137524936s) [noise=true , address=45.91.116.11:4118 , piece_id=LQALELADI5WI53TIO3V3532AZHCYDCHYBS5ZRHCWUOTDVXPQYIBQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.623549430 (11h31m26.138652015s) [noise=true , address=104.36.82.8:4969 , piece_id=Z4IAFCNP6CU2W2YA5GM3DMSSN3E57CCWS25EGRNCMTIT7VB7BHUQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.623999592 (11h31m26.139102175s) [noise=true , address=104.36.82.3:4767 , piece_id=DTATOIMYATZSLL4OGC3CW5LU2LAL7SHEEYTOJNW444GUGDUCEMAQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.624612018 (11h31m26.139714596s) [noise=true , address=77.90.31.11:4553 , piece_id=QVTRCMGH45VHYHZTCDDMOVFENMOMC62VP6RU2BO2O7QNV23SGCVA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.624980690 (11h31m26.140083257s) [noise=true , address=104.36.82.10:4078 , piece_id=KQXQXN7ZLW3C6NZRQ3D32W3DRQUTQ6H2BMF5BAEHVSQAZZGSJ6XQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.754794733 (11h31m26.269897323s) [upload=11985]: Next returned nil segment Aug 7 21:10:51.754842817 (11h31m26.269945393s) [upload=11985]: Waiting for error group managing segments... Aug 7 21:10:51.757292114 (11h31m26.272394684s) [noise=true , address=45.91.116.13:4154 , piece_id=C5EDLMTKRNJGFMQDMVOJKHBDJ2X6LSNMN7BQABZXNPLRTIBD2WWQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.757689863 (11h31m26.272792429s) [noise=true , address=77.90.31.10:4517 , piece_id=3SKPOCWCX5QCXIRA7OXFN2RRV26632KLTKMFYFO4UBDN4OVENMDA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.758182739 (11h31m26.273285302s) [noise=true , address=45.91.116.5:4297 , piece_id=WOS2UDZJLR5RNVS7NVJGS5ONSYHI5MAS3ZU3SWVAX6GDAEYMASUA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.758728233 (11h31m26.273830805s) [noise=true , address=45.91.116.11:4118 , piece_id=LQALELADI5WI53TIO3V3532AZHCYDCHYBS5ZRHCWUOTDVXPQYIBQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.759291109 (11h31m26.274393675s) [noise=true , address=45.91.116.4:4938 , piece_id=KUDVK252OB6OEXANHLYKAOX34EJ6X45EXGHKY6HJKTFHEHZOIT7Q, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.759863622 (11h31m26.274966189s) [noise=true , address=77.90.31.14:4663 , piece_id=EAM2REHEFLGPXKT3VD4RR45YNINBAZ25XPHPGOK7I65MU4DRHRLA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.760338458 (11h31m26.275441027s) [noise=true , address=45.91.116.9:4261 , piece_id=LCBENB7EIEAC2VGCXE6OMJNS6MMN5Z3GWVZV2OEMJGK7YY3QNDRQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.761499557 (11h31m26.276602126s) [noise=true , address=77.90.31.11:4553 , piece_id=QVTRCMGH45VHYHZTCDDMOVFENMOMC62VP6RU2BO2O7QNV23SGCVA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.761841248 (11h31m26.276943816s) [noise=true , address=77.90.31.16:4734 , piece_id=35VEIKUWCTXWBD3UHPWWTKYN4F2SGDXBRPPFN7NKVX5HMJKJZ7YA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764047252 (11h31m26.279149821s) [noise=true , address=104.36.82.8:4969 , piece_id=Z4IAFCNP6CU2W2YA5GM3DMSSN3E57CCWS25EGRNCMTIT7VB7BHUQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764549415 (11h31m26.279651984s) [noise=true , address=104.36.82.10:4078 , piece_id=KQXQXN7ZLW3C6NZRQ3D32W3DRQUTQ6H2BMF5BAEHVSQAZZGSJ6XQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764998813 (11h31m26.280101383s) [noise=true , address=104.36.82.6:4875 , piece_id=3FWNPXWQCC5OBYRKLVGZAILAJK3GSSMJADETENEVQ55OBJXAUUUQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.767598461 (11h31m26.282701031s) [noise=true , address=104.36.82.11:4115 , piece_id=3FGKWCTGGHLRIJGP3IQLN2IARUWGVWLTAV7SP74ZIGNFOIP4VPBA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.767611539 (11h31m26.282714108s) [seg_pos={0 0}, upload=11985]: Segment reached optimal threshold of 13 pieces. Aug 7 21:10:51.767713102 (11h31m26.282815669s) [noise=true , address=104.36.82.15:4258 , piece_id=I3ENXKIHBFN5AR6S5OGGXN5W3L6EWTLPDP65CKEUBLKXBPFWFODA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767798694 (11h31m26.28290126s) [noise=true , address=104.36.82.12:4151 , piece_id=DBMQLDV6IP42H3HTHE2OSEA2HYDLHLB7ZMMDZ3Y6EFEJMBKQWLIA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767868849 (11h31m26.282971411s) [noise=true , address=104.36.82.3:4767 , piece_id=DTATOIMYATZSLL4OGC3CW5LU2LAL7SHEEYTOJNW444GUGDUCEMAQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767881476 (11h31m26.282984053s) [seg_pos={0 0}, upload=11985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:10:51.767953637 (11h31m26.283056214s) [upload=11985]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:10:51.767958621 (11h31m26.283061197s) [upload=11985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:51.821105101 (11h31m26.336207677s) [upload=11985]: Done uploading segments... Aug 7 21:10:51.821124176 (11h31m26.336226743s) [upload=11985]: Upload finished. err: <nil> Aug 7 21:11:13.052093736 (11h31m47.567196306s) [upload=11990]: Starting upload Aug 7 21:11:13.052175286 (11h31m47.567277851s) [upload=11990]: Done starting upload Aug 7 21:11:13.052241959 (11h31m47.567344528s) [upload=11990]: Uploading segments... Aug 7 21:11:13.052616734 (11h31m47.567719311s) [upload=11990]: Got next segment. Inline: false Aug 7 21:11:13.052669021 (11h31m47.567771597s) [upload=11990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:13.052674393 (11h31m47.56777697s) [upload=11990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:11:43.022253349 (11h32m17.537355924s) [upload=11990]: Next segment err: context deadline exceeded Aug 7 21:11:43.022345535 (11h32m17.5374481s) [upload=11990]: Done uploading segments... Aug 7 21:11:43.022365890 (11h32m17.537468457s) [upload=11990]: Upload finished. err: context deadline exceeded Duration: 576.910303ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m19.713723129s FAIL (2025-08-07 21:12:57 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== ug 7 21:11:37.823542297 (11h32m12.338644874s) [upload=11997]: Starting upload Aug 7 21:11:37.823651566 (11h32m12.338754142s) [upload=11997]: Done starting upload Aug 7 21:11:37.823745161 (11h32m12.338847729s) [upload=11997]: Uploading segments... Aug 7 21:11:37.824102050 (11h32m12.339204629s) [upload=11997]: Got next segment. Inline: false Aug 7 21:11:37.824185177 (11h32m12.339287759s) [upload=11997]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:37.824191835 (11h32m12.339294414s) [upload=11997]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:11:49.869142147 (11h32m24.384244722s) [seg_pos={0 0}, upload=11997]: Begin upload segment... Aug 7 21:11:49.869297129 (11h32m24.384399699s) [seg_pos={0 0}, upload=11997]: Done begin upload segment. Aug 7 21:11:49.869321243 (11h32m24.384423819s) [noise=true , address=104.36.82.61:4405 , piece_id=IOUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.870753785 (11h32m24.385856367s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.871782032 (11h32m24.386884617s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.872757979 (11h32m24.387860565s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.873402251 (11h32m24.388504835s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.874007875 (11h32m24.389110457s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.875394772 (11h32m24.390497359s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.875816032 (11h32m24.39091862s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.876209598 (11h32m24.391312188s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.876649290 (11h32m24.391751878s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877055376 (11h32m24.392157964s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877448982 (11h32m24.39255157s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.877851712 (11h32m24.3929543s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878256545 (11h32m24.393359132s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.878707848 (11h32m24.393810434s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879171370 (11h32m24.39427396s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879563499 (11h32m24.394666085s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.879928199 (11h32m24.395030797s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Uploading piece... Aug 7 21:11:49.974975266 (11h32m24.490077832s) [upload=11997]: Next returned nil segment Aug 7 21:11:49.974994144 (11h32m24.49009672s) [upload=11997]: Waiting for error group managing segments... Aug 7 21:11:49.988542190 (11h32m24.50364476s) [noise=true , address=104.36.82.58:4266 , piece_id=F5H6WPF4UQZKLTWOF6IXSHMCHHTQCM6JMVOO75IBFZWV4MTZPQYQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.995910724 (11h32m24.511013304s) [noise=true , address=104.36.82.8:4996 , piece_id=SDSB2I6IRVHIKYNCTXXMMS7QRHP6WQJLTGVSEKHM7TZJXNMSPOTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.996610690 (11h32m24.511713266s) [noise=true , address=45.91.116.5:4322 , piece_id=N2NGYY7VH5K7XORMB263LFAEA6QAG34XIX2EEHA5VRVWN6Y7ICOQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:49.999701015 (11h32m24.514803592s) [noise=true , address=104.36.82.61:4405 , piece_id=IOUNUAQUDRNNPKNFDRBIAM4MHCLESO4JHH3YGXYPRQDHN4IMSF7Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.008965761 (11h32m24.524068325s) [noise=true , address=104.36.82.60:4353 , piece_id=ULO2AG7LYJZQW6RPJ7MELFSAXVO6PGJOQEY74DD54UKFN62PVBPA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.017145206 (11h32m24.532247782s) [noise=true , address=104.36.82.38:4693 , piece_id=VMPINEP4N2EW23O73YZDTLJOK5KTAX7IURQ36YCOL4LXWHAYVNUQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.022781027 (11h32m24.537883606s) [noise=true , address=104.36.82.16:4302 , piece_id=TXFXBAD3J4MFZGTEGPBN77H64Z3NCHCTJOJ23UJVWDRDH5FZUZQA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.023398509 (11h32m24.53850109s) [noise=true , address=104.36.82.14:4256 , piece_id=QOALWOORJKGIRA7SFLFOCDAQZXEUOUIWV3EXABX2ANHJCPUAOVMQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.043528291 (11h32m24.558630869s) [noise=true , address=104.36.82.5:4847 , piece_id=ALFYQ5V3F74HBJW6Y4EEZQ5CPH2FK6TMVZN24M5N26FJUPTKPBBQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.046437033 (11h32m24.561539599s) [noise=true , address=104.36.82.17:4333 , piece_id=RH3RNSP2MCJ55QOLMLM2GG6XIQYMUWDT5CIL4IIUVW6TSBKQ4YVQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.087365961 (11h32m24.602468531s) [noise=true , address=104.36.82.47:4550 , piece_id=XZLYNUXHURQTA5ZV3QM44OQFELJJ26UUSPWH4HXXSK5GNZ4ZNHTA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.160388869 (11h32m24.675491445s) [noise=true , address=104.36.82.52:4095 , piece_id=TIUS4WMCTIOX37O3FTYAFPI6QPGEIWCQ5G2B53O6KXA73W2JWVDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.301621081 (11h32m24.816723645s) [noise=true , address=104.36.82.2:4737 , piece_id=L2KDBV6RNEBV6EWSQLN4XX44BA3PMBXGWNU3BNXTMGF26TZMKKLQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466287316 (11h32m24.981389887s) [noise=true , address=79.127.205.245:4228 , piece_id=SNJK7UVAPUBB4GRL5P4RQ7G7IQ45YISRD7LTTTH47MACDQKOGVXQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: <nil> Aug 7 21:11:50.466310392 (11h32m24.981412969s) [seg_pos={0 0}, upload=11997]: Segment reached optimal threshold of 14 pieces. Aug 7 21:11:50.466545670 (11h32m24.981648233s) [noise=true , address=104.36.82.23:4473 , piece_id=TUI3ZSQYKBCVF7BIQ4EI6ZDURYOTCF2HA3TRI3OGR376XMSCPBTQ, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AKpkGZ6XbeqCTAYe273MACVvMCLcPPJ4By5EX2MkNuxC6zRpC): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.466997931 (11h32m24.982100496s) [noise=true , address=79.127.205.234:4598 , piece_id=QKLRPLUZPQDQYDDT3JDYNQVI3OJ3S4JJQ7GHM5ZEX7DJNH7COWRA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1em3M1WGGYB3mGai2ayAnwWFQU3c6LA3MJQf3PekZcvssk5qaT): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467162262 (11h32m24.982264825s) [noise=true , address=64.49.13.170:4722 , piece_id=NG3CUNOYSNNKBPRWBKICIWMVFVT6Z7S3QMLDWBL3OXRYK37GNSDA, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PwEo82z9nhp4yVv7Ff55AwxHgRLhfuSMmTghTimaoAHu76PXf): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467246223 (11h32m24.982348803s) [noise=true , address=104.36.82.44:4880 , piece_id=EPT4SHLU25E6NWHUDABBKFDG3C3YVFPIF5I35AJI4FZVKIIUED5Q, seg_pos={0 0}, upload=11997]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sFbwzYfjUGQqrKJhgwDg5dvormM1Xu4yc97awR5kgZUAsKiEn): protocol: expected piece hash; context canceled; EOF Aug 7 21:11:50.467281805 (11h32m24.982384369s) [seg_pos={0 0}, upload=11997]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 21:11:50.467362207 (11h32m24.982464787s) [upload=11997]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:11:50.467367803 (11h32m24.982470386s) [upload=11997]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:12:57.502219885 (11h33m32.017322462s) [upload=11997]: Done uploading segments... Aug 7 21:12:57.502247705 (11h33m32.017350283s) [upload=11997]: Upload finished. err: metaclient: context deadline exceeded Duration: 1m19.713815733s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 448.263877ms FAIL (2025-08-07 21:12:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 448.281893ms edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.000979419s FAIL (2025-08-07 21:12:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001001761s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.024521685s FAIL (2025-08-07 21:12:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.024540326s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 422.741917ms FAIL (2025-08-07 21:11:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 1h30m28.790930063s) [upload=11968]: Done uploading segments... Aug 7 21:09:54.275843505 (11h30m28.790946076s) [upload=11968]: Upload finished. err: <nil> Aug 7 21:10:51.587678236 (11h31m26.102780816s) [upload=11985]: Starting upload Aug 7 21:10:51.587761818 (11h31m26.102864396s) [upload=11985]: Done starting upload Aug 7 21:10:51.587860672 (11h31m26.102963249s) [upload=11985]: Uploading segments... Aug 7 21:10:51.588239458 (11h31m26.103342048s) [upload=11985]: Got next segment. Inline: false Aug 7 21:10:51.588360567 (11h31m26.103463145s) [upload=11985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:51.588368110 (11h31m26.103470696s) [upload=11985]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:10:51.618544212 (11h31m26.133646778s) [seg_pos={0 0}, upload=11985]: Begin upload segment... Aug 7 21:10:51.618639398 (11h31m26.13374198s) [seg_pos={0 0}, upload=11985]: Done begin upload segment. Aug 7 21:10:51.618674269 (11h31m26.133776837s) [noise=true , address=104.36.82.6:4875 , piece_id=3FWNPXWQCC5OBYRKLVGZAILAJK3GSSMJADETENEVQ55OBJXAUUUQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619144969 (11h31m26.13424755s) [noise=true , address=45.91.116.9:4261 , piece_id=LCBENB7EIEAC2VGCXE6OMJNS6MMN5Z3GWVZV2OEMJGK7YY3QNDRQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619158689 (11h31m26.134261265s) [noise=true , address=77.90.31.14:4663 , piece_id=EAM2REHEFLGPXKT3VD4RR45YNINBAZ25XPHPGOK7I65MU4DRHRLA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619516851 (11h31m26.134619428s) [noise=true , address=104.36.82.15:4258 , piece_id=I3ENXKIHBFN5AR6S5OGGXN5W3L6EWTLPDP65CKEUBLKXBPFWFODA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619793570 (11h31m26.134896149s) [noise=true , address=104.36.82.11:4115 , piece_id=3FGKWCTGGHLRIJGP3IQLN2IARUWGVWLTAV7SP74ZIGNFOIP4VPBA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619978882 (11h31m26.135081465s) [noise=true , address=77.90.31.16:4734 , piece_id=35VEIKUWCTXWBD3UHPWWTKYN4F2SGDXBRPPFN7NKVX5HMJKJZ7YA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620436377 (11h31m26.135538954s) [noise=true , address=77.90.31.10:4517 , piece_id=3SKPOCWCX5QCXIRA7OXFN2RRV26632KLTKMFYFO4UBDN4OVENMDA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620692287 (11h31m26.135794882s) [noise=true , address=45.91.116.13:4154 , piece_id=C5EDLMTKRNJGFMQDMVOJKHBDJ2X6LSNMN7BQABZXNPLRTIBD2WWQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620967442 (11h31m26.136070021s) [noise=true , address=45.91.116.4:4938 , piece_id=KUDVK252OB6OEXANHLYKAOX34EJ6X45EXGHKY6HJKTFHEHZOIT7Q, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.621052086 (11h31m26.136154673s) [noise=true , address=45.91.116.5:4297 , piece_id=WOS2UDZJLR5RNVS7NVJGS5ONSYHI5MAS3ZU3SWVAX6GDAEYMASUA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.621397153 (11h31m26.136499739s) [noise=true , address=104.36.82.12:4151 , piece_id=DBMQLDV6IP42H3HTHE2OSEA2HYDLHLB7ZMMDZ3Y6EFEJMBKQWLIA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.622422358 (11h31m26.137524936s) [noise=true , address=45.91.116.11:4118 , piece_id=LQALELADI5WI53TIO3V3532AZHCYDCHYBS5ZRHCWUOTDVXPQYIBQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.623549430 (11h31m26.138652015s) [noise=true , address=104.36.82.8:4969 , piece_id=Z4IAFCNP6CU2W2YA5GM3DMSSN3E57CCWS25EGRNCMTIT7VB7BHUQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.623999592 (11h31m26.139102175s) [noise=true , address=104.36.82.3:4767 , piece_id=DTATOIMYATZSLL4OGC3CW5LU2LAL7SHEEYTOJNW444GUGDUCEMAQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.624612018 (11h31m26.139714596s) [noise=true , address=77.90.31.11:4553 , piece_id=QVTRCMGH45VHYHZTCDDMOVFENMOMC62VP6RU2BO2O7QNV23SGCVA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.624980690 (11h31m26.140083257s) [noise=true , address=104.36.82.10:4078 , piece_id=KQXQXN7ZLW3C6NZRQ3D32W3DRQUTQ6H2BMF5BAEHVSQAZZGSJ6XQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.754794733 (11h31m26.269897323s) [upload=11985]: Next returned nil segment Aug 7 21:10:51.754842817 (11h31m26.269945393s) [upload=11985]: Waiting for error group managing segments... Aug 7 21:10:51.757292114 (11h31m26.272394684s) [noise=true , address=45.91.116.13:4154 , piece_id=C5EDLMTKRNJGFMQDMVOJKHBDJ2X6LSNMN7BQABZXNPLRTIBD2WWQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.757689863 (11h31m26.272792429s) [noise=true , address=77.90.31.10:4517 , piece_id=3SKPOCWCX5QCXIRA7OXFN2RRV26632KLTKMFYFO4UBDN4OVENMDA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.758182739 (11h31m26.273285302s) [noise=true , address=45.91.116.5:4297 , piece_id=WOS2UDZJLR5RNVS7NVJGS5ONSYHI5MAS3ZU3SWVAX6GDAEYMASUA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.758728233 (11h31m26.273830805s) [noise=true , address=45.91.116.11:4118 , piece_id=LQALELADI5WI53TIO3V3532AZHCYDCHYBS5ZRHCWUOTDVXPQYIBQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.759291109 (11h31m26.274393675s) [noise=true , address=45.91.116.4:4938 , piece_id=KUDVK252OB6OEXANHLYKAOX34EJ6X45EXGHKY6HJKTFHEHZOIT7Q, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.759863622 (11h31m26.274966189s) [noise=true , address=77.90.31.14:4663 , piece_id=EAM2REHEFLGPXKT3VD4RR45YNINBAZ25XPHPGOK7I65MU4DRHRLA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.760338458 (11h31m26.275441027s) [noise=true , address=45.91.116.9:4261 , piece_id=LCBENB7EIEAC2VGCXE6OMJNS6MMN5Z3GWVZV2OEMJGK7YY3QNDRQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.761499557 (11h31m26.276602126s) [noise=true , address=77.90.31.11:4553 , piece_id=QVTRCMGH45VHYHZTCDDMOVFENMOMC62VP6RU2BO2O7QNV23SGCVA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.761841248 (11h31m26.276943816s) [noise=true , address=77.90.31.16:4734 , piece_id=35VEIKUWCTXWBD3UHPWWTKYN4F2SGDXBRPPFN7NKVX5HMJKJZ7YA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764047252 (11h31m26.279149821s) [noise=true , address=104.36.82.8:4969 , piece_id=Z4IAFCNP6CU2W2YA5GM3DMSSN3E57CCWS25EGRNCMTIT7VB7BHUQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764549415 (11h31m26.279651984s) [noise=true , address=104.36.82.10:4078 , piece_id=KQXQXN7ZLW3C6NZRQ3D32W3DRQUTQ6H2BMF5BAEHVSQAZZGSJ6XQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764998813 (11h31m26.280101383s) [noise=true , address=104.36.82.6:4875 , piece_id=3FWNPXWQCC5OBYRKLVGZAILAJK3GSSMJADETENEVQ55OBJXAUUUQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.767598461 (11h31m26.282701031s) [noise=true , address=104.36.82.11:4115 , piece_id=3FGKWCTGGHLRIJGP3IQLN2IARUWGVWLTAV7SP74ZIGNFOIP4VPBA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.767611539 (11h31m26.282714108s) [seg_pos={0 0}, upload=11985]: Segment reached optimal threshold of 13 pieces. Aug 7 21:10:51.767713102 (11h31m26.282815669s) [noise=true , address=104.36.82.15:4258 , piece_id=I3ENXKIHBFN5AR6S5OGGXN5W3L6EWTLPDP65CKEUBLKXBPFWFODA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767798694 (11h31m26.28290126s) [noise=true , address=104.36.82.12:4151 , piece_id=DBMQLDV6IP42H3HTHE2OSEA2HYDLHLB7ZMMDZ3Y6EFEJMBKQWLIA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767868849 (11h31m26.282971411s) [noise=true , address=104.36.82.3:4767 , piece_id=DTATOIMYATZSLL4OGC3CW5LU2LAL7SHEEYTOJNW444GUGDUCEMAQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767881476 (11h31m26.282984053s) [seg_pos={0 0}, upload=11985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:10:51.767953637 (11h31m26.283056214s) [upload=11985]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:10:51.767958621 (11h31m26.283061197s) [upload=11985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:51.821105101 (11h31m26.336207677s) [upload=11985]: Done uploading segments... Aug 7 21:10:51.821124176 (11h31m26.336226743s) [upload=11985]: Upload finished. err: <nil> Aug 7 21:11:13.052093736 (11h31m47.567196306s) [upload=11990]: Starting upload Aug 7 21:11:13.052175286 (11h31m47.567277851s) [upload=11990]: Done starting upload Aug 7 21:11:13.052241959 (11h31m47.567344528s) [upload=11990]: Uploading segments... Aug 7 21:11:13.052616734 (11h31m47.567719311s) [upload=11990]: Got next segment. Inline: false Aug 7 21:11:13.052669021 (11h31m47.567771597s) [upload=11990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:13.052674393 (11h31m47.56777697s) [upload=11990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:11:43.022253349 (11h32m17.537355924s) [upload=11990]: Next segment err: context deadline exceeded Aug 7 21:11:43.022345535 (11h32m17.5374481s) [upload=11990]: Done uploading segments... Aug 7 21:11:43.022365890 (11h32m17.537468457s) [upload=11990]: Upload finished. err: context deadline exceeded Duration: 422.765509ms core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.00060031s FAIL (2025-08-07 21:11:43 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: encryption: context deadline exceeded ======LOGS====== 1h30m28.790930063s) [upload=11968]: Done uploading segments... Aug 7 21:09:54.275843505 (11h30m28.790946076s) [upload=11968]: Upload finished. err: <nil> Aug 7 21:10:51.587678236 (11h31m26.102780816s) [upload=11985]: Starting upload Aug 7 21:10:51.587761818 (11h31m26.102864396s) [upload=11985]: Done starting upload Aug 7 21:10:51.587860672 (11h31m26.102963249s) [upload=11985]: Uploading segments... Aug 7 21:10:51.588239458 (11h31m26.103342048s) [upload=11985]: Got next segment. Inline: false Aug 7 21:10:51.588360567 (11h31m26.103463145s) [upload=11985]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:10:51.588368110 (11h31m26.103470696s) [upload=11985]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:10:51.618544212 (11h31m26.133646778s) [seg_pos={0 0}, upload=11985]: Begin upload segment... Aug 7 21:10:51.618639398 (11h31m26.13374198s) [seg_pos={0 0}, upload=11985]: Done begin upload segment. Aug 7 21:10:51.618674269 (11h31m26.133776837s) [noise=true , address=104.36.82.6:4875 , piece_id=3FWNPXWQCC5OBYRKLVGZAILAJK3GSSMJADETENEVQ55OBJXAUUUQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619144969 (11h31m26.13424755s) [noise=true , address=45.91.116.9:4261 , piece_id=LCBENB7EIEAC2VGCXE6OMJNS6MMN5Z3GWVZV2OEMJGK7YY3QNDRQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619158689 (11h31m26.134261265s) [noise=true , address=77.90.31.14:4663 , piece_id=EAM2REHEFLGPXKT3VD4RR45YNINBAZ25XPHPGOK7I65MU4DRHRLA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619516851 (11h31m26.134619428s) [noise=true , address=104.36.82.15:4258 , piece_id=I3ENXKIHBFN5AR6S5OGGXN5W3L6EWTLPDP65CKEUBLKXBPFWFODA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619793570 (11h31m26.134896149s) [noise=true , address=104.36.82.11:4115 , piece_id=3FGKWCTGGHLRIJGP3IQLN2IARUWGVWLTAV7SP74ZIGNFOIP4VPBA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.619978882 (11h31m26.135081465s) [noise=true , address=77.90.31.16:4734 , piece_id=35VEIKUWCTXWBD3UHPWWTKYN4F2SGDXBRPPFN7NKVX5HMJKJZ7YA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620436377 (11h31m26.135538954s) [noise=true , address=77.90.31.10:4517 , piece_id=3SKPOCWCX5QCXIRA7OXFN2RRV26632KLTKMFYFO4UBDN4OVENMDA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620692287 (11h31m26.135794882s) [noise=true , address=45.91.116.13:4154 , piece_id=C5EDLMTKRNJGFMQDMVOJKHBDJ2X6LSNMN7BQABZXNPLRTIBD2WWQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.620967442 (11h31m26.136070021s) [noise=true , address=45.91.116.4:4938 , piece_id=KUDVK252OB6OEXANHLYKAOX34EJ6X45EXGHKY6HJKTFHEHZOIT7Q, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.621052086 (11h31m26.136154673s) [noise=true , address=45.91.116.5:4297 , piece_id=WOS2UDZJLR5RNVS7NVJGS5ONSYHI5MAS3ZU3SWVAX6GDAEYMASUA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.621397153 (11h31m26.136499739s) [noise=true , address=104.36.82.12:4151 , piece_id=DBMQLDV6IP42H3HTHE2OSEA2HYDLHLB7ZMMDZ3Y6EFEJMBKQWLIA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.622422358 (11h31m26.137524936s) [noise=true , address=45.91.116.11:4118 , piece_id=LQALELADI5WI53TIO3V3532AZHCYDCHYBS5ZRHCWUOTDVXPQYIBQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.623549430 (11h31m26.138652015s) [noise=true , address=104.36.82.8:4969 , piece_id=Z4IAFCNP6CU2W2YA5GM3DMSSN3E57CCWS25EGRNCMTIT7VB7BHUQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.623999592 (11h31m26.139102175s) [noise=true , address=104.36.82.3:4767 , piece_id=DTATOIMYATZSLL4OGC3CW5LU2LAL7SHEEYTOJNW444GUGDUCEMAQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.624612018 (11h31m26.139714596s) [noise=true , address=77.90.31.11:4553 , piece_id=QVTRCMGH45VHYHZTCDDMOVFENMOMC62VP6RU2BO2O7QNV23SGCVA, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.624980690 (11h31m26.140083257s) [noise=true , address=104.36.82.10:4078 , piece_id=KQXQXN7ZLW3C6NZRQ3D32W3DRQUTQ6H2BMF5BAEHVSQAZZGSJ6XQ, seg_pos={0 0}, upload=11985]: Uploading piece... Aug 7 21:10:51.754794733 (11h31m26.269897323s) [upload=11985]: Next returned nil segment Aug 7 21:10:51.754842817 (11h31m26.269945393s) [upload=11985]: Waiting for error group managing segments... Aug 7 21:10:51.757292114 (11h31m26.272394684s) [noise=true , address=45.91.116.13:4154 , piece_id=C5EDLMTKRNJGFMQDMVOJKHBDJ2X6LSNMN7BQABZXNPLRTIBD2WWQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.757689863 (11h31m26.272792429s) [noise=true , address=77.90.31.10:4517 , piece_id=3SKPOCWCX5QCXIRA7OXFN2RRV26632KLTKMFYFO4UBDN4OVENMDA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.758182739 (11h31m26.273285302s) [noise=true , address=45.91.116.5:4297 , piece_id=WOS2UDZJLR5RNVS7NVJGS5ONSYHI5MAS3ZU3SWVAX6GDAEYMASUA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.758728233 (11h31m26.273830805s) [noise=true , address=45.91.116.11:4118 , piece_id=LQALELADI5WI53TIO3V3532AZHCYDCHYBS5ZRHCWUOTDVXPQYIBQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.759291109 (11h31m26.274393675s) [noise=true , address=45.91.116.4:4938 , piece_id=KUDVK252OB6OEXANHLYKAOX34EJ6X45EXGHKY6HJKTFHEHZOIT7Q, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.759863622 (11h31m26.274966189s) [noise=true , address=77.90.31.14:4663 , piece_id=EAM2REHEFLGPXKT3VD4RR45YNINBAZ25XPHPGOK7I65MU4DRHRLA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.760338458 (11h31m26.275441027s) [noise=true , address=45.91.116.9:4261 , piece_id=LCBENB7EIEAC2VGCXE6OMJNS6MMN5Z3GWVZV2OEMJGK7YY3QNDRQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.761499557 (11h31m26.276602126s) [noise=true , address=77.90.31.11:4553 , piece_id=QVTRCMGH45VHYHZTCDDMOVFENMOMC62VP6RU2BO2O7QNV23SGCVA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.761841248 (11h31m26.276943816s) [noise=true , address=77.90.31.16:4734 , piece_id=35VEIKUWCTXWBD3UHPWWTKYN4F2SGDXBRPPFN7NKVX5HMJKJZ7YA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764047252 (11h31m26.279149821s) [noise=true , address=104.36.82.8:4969 , piece_id=Z4IAFCNP6CU2W2YA5GM3DMSSN3E57CCWS25EGRNCMTIT7VB7BHUQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764549415 (11h31m26.279651984s) [noise=true , address=104.36.82.10:4078 , piece_id=KQXQXN7ZLW3C6NZRQ3D32W3DRQUTQ6H2BMF5BAEHVSQAZZGSJ6XQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.764998813 (11h31m26.280101383s) [noise=true , address=104.36.82.6:4875 , piece_id=3FWNPXWQCC5OBYRKLVGZAILAJK3GSSMJADETENEVQ55OBJXAUUUQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.767598461 (11h31m26.282701031s) [noise=true , address=104.36.82.11:4115 , piece_id=3FGKWCTGGHLRIJGP3IQLN2IARUWGVWLTAV7SP74ZIGNFOIP4VPBA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: <nil> Aug 7 21:10:51.767611539 (11h31m26.282714108s) [seg_pos={0 0}, upload=11985]: Segment reached optimal threshold of 13 pieces. Aug 7 21:10:51.767713102 (11h31m26.282815669s) [noise=true , address=104.36.82.15:4258 , piece_id=I3ENXKIHBFN5AR6S5OGGXN5W3L6EWTLPDP65CKEUBLKXBPFWFODA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8RkyjiDQ2nNkM8drWhAKuBQfGizv711hyBDNB11noDzq1xtF): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767798694 (11h31m26.28290126s) [noise=true , address=104.36.82.12:4151 , piece_id=DBMQLDV6IP42H3HTHE2OSEA2HYDLHLB7ZMMDZ3Y6EFEJMBKQWLIA, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1w6pwZMdeQKjt92qx6WbTWU5VPYJto5gS87f6iKvCBZH6LfyeB): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767868849 (11h31m26.282971411s) [noise=true , address=104.36.82.3:4767 , piece_id=DTATOIMYATZSLL4OGC3CW5LU2LAL7SHEEYTOJNW444GUGDUCEMAQ, seg_pos={0 0}, upload=11985]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Aug 7 21:10:51.767881476 (11h31m26.282984053s) [seg_pos={0 0}, upload=11985]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Aug 7 21:10:51.767953637 (11h31m26.283056214s) [upload=11985]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 21:10:51.767958621 (11h31m26.283061197s) [upload=11985]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 21:10:51.821105101 (11h31m26.336207677s) [upload=11985]: Done uploading segments... Aug 7 21:10:51.821124176 (11h31m26.336226743s) [upload=11985]: Upload finished. err: <nil> Aug 7 21:11:13.052093736 (11h31m47.567196306s) [upload=11990]: Starting upload Aug 7 21:11:13.052175286 (11h31m47.567277851s) [upload=11990]: Done starting upload Aug 7 21:11:13.052241959 (11h31m47.567344528s) [upload=11990]: Uploading segments... Aug 7 21:11:13.052616734 (11h31m47.567719311s) [upload=11990]: Got next segment. Inline: false Aug 7 21:11:13.052669021 (11h31m47.567771597s) [upload=11990]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 7 21:11:13.052674393 (11h31m47.56777697s) [upload=11990]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 21:11:43.022253349 (11h32m17.537355924s) [upload=11990]: Next segment err: context deadline exceeded Aug 7 21:11:43.022345535 (11h32m17.5374481s) [upload=11990]: Done uploading segments... Aug 7 21:11:43.022365890 (11h32m17.537468457s) [upload=11990]: Upload finished. err: context deadline exceeded Duration: 30.000621797s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 692.556397ms FAIL (2025-08-07 20:12:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 692.586209ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 751.633562ms FAIL (2025-08-07 20:11:36 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 751.684936ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 1.137088271s FAIL (2025-08-07 20:10:28 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 1.137118206s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 1.013847308s FAIL (2025-08-07 20:10:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 1.013887729s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 1.26025378s FAIL (2025-08-07 20:09:37 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 1.260281254s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 728.693225ms FAIL (2025-08-07 20:09:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 728.786926ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 903.254668ms FAIL (2025-08-07 20:07:54 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 903.283023ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 673.730186ms FAIL (2025-08-07 20:07:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 673.754666ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 805.700111ms FAIL (2025-08-07 20:06:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 805.725884ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 681.207082ms FAIL (2025-08-07 20:05:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 681.2334ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 492.600158ms FAIL (2025-08-07 20:04:41 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== 166809216 (9h48m18.681911779s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 7 19:27:44.257934312 (9h48m18.773036889s) [seg_pos={0 0}, upload=10188]: Begin upload segment... Aug 7 19:27:44.257996231 (9h48m18.7730988s) [seg_pos={0 0}, upload=10188]: Done begin upload segment. Aug 7 19:27:44.258022674 (9h48m18.77312526s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258043683 (9h48m18.773146262s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258513506 (9h48m18.773616089s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258546830 (9h48m18.773649412s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258881415 (9h48m18.773983991s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.258961815 (9h48m18.774064402s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259348281 (9h48m18.774450865s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259520102 (9h48m18.774622665s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.259993675 (9h48m18.775096252s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.264333871 (9h48m18.779436465s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.265687285 (9h48m18.780789871s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.267245609 (9h48m18.782348198s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.268499259 (9h48m18.783601842s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.269776004 (9h48m18.784878581s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270220459 (9h48m18.785323044s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.270725622 (9h48m18.78582821s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.271272430 (9h48m18.786375016s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.272539539 (9h48m18.787642125s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Uploading piece... Aug 7 19:27:44.348232691 (9h48m18.863335261s) [upload=10188]: Next returned nil segment Aug 7 19:27:44.348248162 (9h48m18.863350739s) [upload=10188]: Waiting for error group managing segments... Aug 7 19:27:44.356167964 (9h48m18.87127054s) [noise=true , address=45.91.116.4:4969 , piece_id=ICMGGHQUSFXRAL5OBRAVY5LIPWHL6SWFRKX3YC344H22YEWLLCCA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.367092458 (9h48m18.882195024s) [noise=true , address=104.36.82.62:4433 , piece_id=CJQZB622H3WNJS5JTHCCAAWSMW5QPCSPFRQ42W23D5V7HI4E3JMA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.368359667 (9h48m18.883462244s) [noise=true , address=104.36.82.37:4687 , piece_id=AP6QR34WORDHXXZ7A2PAWQDLL2SB2T7VNQJDQPEV6DIEUPSDYOEQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.376765689 (9h48m18.89186827s) [noise=true , address=104.36.82.45:4910 , piece_id=TLQDS2R25ADI6OMLLTBYQD26I2ETVLHZX53WVBE6B6HZL4TM5NPQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377537444 (9h48m18.892640019s) [noise=true , address=104.36.82.47:4524 , piece_id=H5FE44S3GCKAQ5AWQEPRKRANABRDTVAIWBBQUSQTUFAKSEB6ETRA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.377596012 (9h48m18.892698582s) [noise=true , address=104.36.82.4:4833 , piece_id=26GCYW3MHAFC27KBIPSDO7UBDBMJ3GEMEC5DYCTJ7NIQETPKI3LQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.379981851 (9h48m18.895084432s) [noise=true , address=104.36.82.47:4535 , piece_id=G2RJBDSEV7BWTWQSBCMMGS6I2HXHQWPFLCSSG2WRPBFDYKGFBMDA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.381032713 (9h48m18.896135283s) [noise=true , address=104.36.82.60:4353 , piece_id=AQKEV7FNVAXG2VN4BBEGS7LJJ3DTLODXABE3UDH4IZ3Q2MWGLSXQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.382842944 (9h48m18.897945514s) [noise=true , address=104.36.82.46:4510 , piece_id=UGRTNTU7BHWJV272YRHAFQRVHPC2SLRQJ6LXEFRW35NBSMFEFXAA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398755501 (9h48m18.913858067s) [noise=true , address=104.36.82.5:4849 , piece_id=5AE2RCQVCDR73IHX5G6KGM7VY4HXGD5C74PP3ZYWQEWWBJ436ZTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.398846572 (9h48m18.913949156s) [noise=true , address=104.36.82.16:4326 , piece_id=YQDIP5DCDJIYMWYRBWP7NDRHYSETJHMDYGARVVEJFX6ZURTWL3CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.415219008 (9h48m18.930321571s) [noise=true , address=45.91.116.10:4098 , piece_id=O3QMJBJHX63SPGWODSZF3F43RQJTB2ZDHT7VMLWPS62ZPCMY7NPA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.444064515 (9h48m18.959167091s) [noise=true , address=104.36.82.61:4393 , piece_id=Y3TEC3ZO3KCAH3TRK2BYWAWUXEJHRMGGGDB3MJNDDO7JGYKFGC7Q, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571373962 (9h48m19.086476529s) [noise=true , address=79.127.201.215:4353 , piece_id=TPCHJCHKLIPMGVBR4TOL4PWQMXBSMN75IFIFEW4ANPZ72I6D7LHQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: <nil> Aug 7 19:27:44.571549795 (9h48m19.086652379s) [seg_pos={0 0}, upload=10188]: Segment reached optimal threshold of 14 pieces. Aug 7 19:27:44.572012604 (9h48m19.087115172s) [noise=true , address=64.49.13.140:4505 , piece_id=JEEC5B6X6ZDSH6BMSU7E5SGQKGHSNBSVV3LFTFRGDNNVAIZISOCQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AbFiw33iRaTCNbSt9NmCYG1KBqys85G5VcgXndydkzgnxN4L4): protocol: read tcp 159.223.143.39:51796->64.49.13.140:4505: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572207590 (9h48m19.087310157s) [noise=true , address=104.36.82.23:4446 , piece_id=Q3PYTGGIK3Y5J3SLOBXOJ4DRPQ3SGXVL53ES27TOFBPNITJTJ2CA, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RNJPWzogZpsQfuFzJYZiz8bbHSRSrgSE5FLyhCynSwEDfMid7): protocol: read tcp 159.223.143.39:33490->104.36.82.23:4446: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572438734 (9h48m19.087541301s) [noise=true , address=79.127.205.234:4594 , piece_id=BG6EI57M4V7ATEGN7SVPAKUGSON5FLWUPWGJVYYMMAPNPSMDPVTQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Yerb4RJr5S5Q5G5ZAazicQhTM3MP7JcS1tVjCstAQ18wxP6bp): protocol: read tcp 159.223.143.39:35550->79.127.205.234:4594: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 7 19:27:44.572572919 (9h48m19.087675488s) [noise=true , address=104.36.82.14:4231 , piece_id=D7PUUWJR6DUNGQ627FMVNUEBRKQNZL46OKG6O3GV6GCLZ6I3WYAQ, seg_pos={0 0}, upload=10188]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ixY5pokE6MtrVH9FpKc1tGZhEAaW5brbzBeeGmYUczK3z7tCQ): protocol: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection; piecestore: piecestore close: write tcp 159.223.143.39:47622->104.36.82.14:4231: use of closed network connection Aug 7 19:27:44.572585181 (9h48m19.08768775s) [seg_pos={0 0}, upload=10188]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 7 19:27:44.572672789 (9h48m19.087775356s) [upload=10188]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 7 19:27:44.572677582 (9h48m19.08778016s) [upload=10188]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 7 19:27:44.737169586 (9h48m19.252272173s) [upload=10188]: Done uploading segments... Aug 7 19:27:44.737191099 (9h48m19.252293676s) [upload=10188]: Upload finished. err: <nil> Duration:* 492.625966ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)