this post was submitted on 27 Aug 2024
22 points (92.3% liked)

Selfhosted

40132 readers
572 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
 

I am setting up a Linux server (probably will be NixOS) where my VM disk files will be stored on top of an NTFS partition. (Yes I know NTFS sucks but it has to be this way.)

I am asking which guest filesystem will have the best performance for a very mixed workload. If I had access to the extra features of BTRFS or ZFS I would use them but I have no idea how CoW interacts with NTFS; that is why I am asking here.

Also I would like some NTFS performance tuning pointers.

top 14 comments
sorted by: hot top controversial new old
[–] MissLazorBoobies@yiffit.net 15 points 2 months ago (1 children)

why does it have to be this way?

[–] Wangus@lemmy.world 2 points 2 months ago

I would also like to know why it has to be this way. Are you planning to dual boot I need that partition available in Windows?

[–] Shadow@lemmy.ca 13 points 2 months ago* (last edited 2 months ago)

Ntfs isn't going to care or even be aware of the hypervisor FS, zfs or btrfs would both work fine.

Making sure you don't have misaligned sectors, is pretty much the only major pitfall. Make sure you use paravirt storage and network drivers.

Edit: I just realized you're asking for the opposite direction, but ultimately the same guidelines apply. It doesn't matter what filesystems are on what, with the above caveats.

[–] one_knight_scripting@lemmy.world 3 points 2 months ago

Yeah, I'd just like to ask why it has to be NTFS as well. I want to help you to the best of my ability.

Now in terms of what you are trying to accomplish, it would sincerely help to know what kind of server you are trying to create and what you want it to accomplish so I can help you with the design. It would also help to know what hypervisor you are using to read those VM disks. Now, for the sake of the rest of this post, I'm going to assume that you are simply creating a Linux server meant to share those disks with a hyper-v hypervisor (to ensure we discuss the worst case... Lol... but also because I think the only reason you need NTFS is to support a Windows hypervisor).

Now if that assumption is correct, I would still ask why the filesystem must be NTFS. If all you need is a share for the files then why does the filesystem even matter? In my opinion, the worst case scenario that you have is a samba share which shares these files over as a Windows share. Now Windows is capable of better sharing utilizing either iscsi or NFS. None of these three sharing solutions (samba, iscsi, NFS) require an NTFS filesystem. Though I will admit that there may be some other thing that causes an issue with the potential of these solutions.

Anyways, not to pry, I want to help you though but a little more detail would significantly help with helping you find a solution.

[–] CMDR_Horn@lemmy.world 2 points 2 months ago

What will this be running on?

[–] Bakkoda@sh.itjust.works 1 points 2 months ago

Is it possible to do something like iscsi?

[–] SteveTech@programming.dev 1 points 2 months ago

I have no idea how CoW interacts with NTFS

With btrfs you can disable COW for specific files, that might give you a little performance boost.

[–] possiblylinux127@lemmy.zip 1 points 2 months ago (1 children)

I don't understand. Why would you store VM disks on NTFS? This isn't a viable solution and you need to rethink your design. Also for guest filesystems I would go with ext4 as it has lower overhead while still being reasonably modern.

[–] pyrosis@lemmy.world 1 points 2 months ago (1 children)

Within guests these days I just use XFS, UFS, or NTFS depending on the os. The hypervisor can have zfs or ceph.

[–] possiblylinux127@lemmy.zip 1 points 2 months ago (1 children)

Ufs seems weird to use outside of flash

[–] pyrosis@lemmy.world 1 points 2 months ago (1 children)

It seems that way but it performs better than zfs on top of zfs. The only os I ran into that with was opnsense when I was playing with a virtualized firewall.

[–] possiblylinux127@lemmy.zip 1 points 2 months ago* (last edited 2 months ago) (1 children)

Don't do ZFS on ZFS. It will destroy performance.

I personally go for EXT4 as is solid and light weight. It is also somewhat resistant to power loss

[–] pyrosis@lemmy.world 1 points 2 months ago

That's what I said. Cow on top of cow is bad. Pretty sure ext4 isn't on option on opnsense. UFS or zfs. Which is the only reason I mentioned it at all when presented with that choice.

[–] catloaf@lemm.ee 0 points 2 months ago

If you're really concerned with performance, benchmark each one in your own environment.

Ideally, you just wouldn't do this.