Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
eupolicy.social is one of the many independent Mastodon servers you can use to participate in the fediverse.
This Mastodon server is a friendly and respectful discussion space for people working in areas related to EU policy. When you request to create an account, please tell us something about you.

Administered by:

Server stats:

224
active users

eupolicy.social: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.6

#xargs

0 posts0 participants0 posts today
Joerg Jaspert :debian:<p>Ok. Remotely cleaning a huge (&gt;2 TB, many many files and subdirs) <a href="https://fulda.social/tags/Nextcloud" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Nextcloud</span></a>-hosted folder (not the whole user) is *painful*. Without access to the host it runs on I am limited to either the webinterface - which breaks - or using <a href="https://fulda.social/tags/webdav" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>webdav</span></a> with a tool like <a href="https://fulda.social/tags/rclone" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>rclone</span></a>.</p><p><a href="https://fulda.social/tags/rclone" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>rclone</span></a> purge breaks (timeout), so rclone delete it is. Which is *slow*, really slow. Probably because the remote moves a deleted file into the (for this case) useless trashbin which can't be turned off.</p><p>At least one can use <a href="https://fulda.social/tags/xargs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>xargs</span></a> to run multiple rclones in parallel - first get a list of entries of the to-be-deleted-dir (rclone lsf), format them the way rclone expects (basically put name of remote in front) and use something like `xargs -n 1 -P0 rclone delete -v --rmdirs` on it.</p><p>Still, its running since yesterday later afternoon and we are down to 1.4Tb left, of 2Tb. Even in parallel, the webdav shit manages to delete 2 to 4 files a second only.</p>
Feoh<p><a href="https://oldbytes.space/tags/unix" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>unix</span></a> is awesome <a href="https://oldbytes.space/tags/oneliner" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>oneliner</span></a> <a href="https://oldbytes.space/tags/otd" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>otd</span></a> </p><p>"Hey UNIX, give me a list of all our infra projects that create databases sorted by linecount"</p><p>rg -l OLAmazonDB | xargs wc -l | sort</p><p>This message brought to you by the awesome power of <a href="https://oldbytes.space/tags/ripgrep" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ripgrep</span></a> and <a href="https://oldbytes.space/tags/xargs" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>xargs</span></a> :)</p>
ExploreLive feeds
About