Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum. |
Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
|
 |
05-09-2025, 02:29 AM
|
#1
|
Member
Registered: Oct 2022
Posts: 115
Rep:
|
Observation: ISO9660 is faster than UDF on thousands of files.
[ Log in to get rid of this advertisement]
File listings with several thousands of files load noticeably faster on ISO9660 than on UDF.
If you want to write many small files a disc, you might want to use ISO9660 only. UDF is of course needed for files above 4 GiB (if your authoring software doesn't support ISO9660 multi-part files) and if you need to support file names over 64 characters on Windows (Joliet limitation), given that Rock Ridge is recognized by Linux (and some other Unix-like systems) only.
(For clarity: Joliet and Rock Ridge are extensions to ISO9660, not standalone file systems.)
Of course, disc-at-once written UDF still loads more than 10 times faster than packet-written UDF from Windows, given that the entire file list is in one place, not scattered around the disc.
Just wanted to share it in case anyone finds it useful.
Last edited by exerceo; 05-09-2025 at 02:30 AM.
|
|
|
05-09-2025, 07:08 AM
|
#2
|
LQ Guru
Registered: Feb 2004
Location: SE Tennessee, USA
Distribution: Gentoo, LFS
Posts: 11,294
|
"Thousands of files in a single directory" is always a problem, for any file system . . . If possible, break the files into subdirectories by portions of their name. You will be very glad you did.
|
|
1 members found this post helpful.
|
05-09-2025, 05:11 PM
|
#3
|
Member
Registered: Oct 2022
Posts: 115
Original Poster
Rep:
|
Problem with thousands of files in one directory?
Quote:
Originally Posted by sundialsvcs
"Thousands of files in a single directory" is always a problem, for any file system . . . If possible, break the files into subdirectories by portions of their name. You will be very glad you did.
|
Could you elaborate?
I deal with several thousand files in one directory regularly. Besides occasional slow loading due to file managers trying to read the signature of many files, I didn't face other issues I can think of.
On the local drive, ext4 handles even tens of thousands of files as smooth as silk. But it seems FAT32 and NTFS are slower with thousands of files. exFAT is somewhere inbetween, but closer to ext4. This is just from my feeling; I haven't done tests with exact timing yet.
For disc-at-once UDF and ISO9660 it doesn't matter because it has to be written once only.
Last edited by exerceo; 05-09-2025 at 05:16 PM.
Reason: more accurately worded
|
|
|
05-10-2025, 09:51 AM
|
#4
|
Member
Registered: Apr 2024
Distribution: Arch Linux, wsl
Posts: 49
Rep:
|
If you are dealing with files like a bunch of musics, I will forgive you. But one thousand or so is the maximum I will want to deal with.
Moreover, it not only bother the heck out of a pc to process this headache for you, but a pain in the ass if you are to do search within those files, well, if you need to find one or more of them.
We are humans, and humans need folders to store their junk. Use them well.
|
|
|
05-11-2025, 02:28 AM
|
#5
|
LQ Addict
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 24,447
|
as an example git stores (and not only git) its internal data in several subdirs, not in bulk.
|
|
|
05-16-2025, 12:36 AM
|
#6
|
LQ Guru
Registered: Aug 2004
Location: Sydney
Distribution: Rocky 9.x
Posts: 18,442
|
@ exerceo :
Your comparisons in post #3 make perfect sense.
In terms of capabilities:
FAT > exFAT > NTFS
ext2 > ext3 > ext4
NTFS was released in 1993 , as was ext2(!). iirc, ext2 was at least as good as NTFS, possibly better ...
There are in-depth articles on all of these filesystems in wikipedia if you really want to know the details.
|
|
|
All times are GMT -5. The time now is 04:20 PM.
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
Latest Threads
LQ News
|
|