Messages In This Digest (5 Messages)

1a.: Re: Mass File Copy Problems, 40,000 files From: Alan Fry
1b.: Re: Mass File Copy Problems, 40,000 files From: Alan Fry
1c.: Re: Mass File Copy Problems, 40,000 files From: Katie Clark
1d.: Re: Mass File Copy Problems, 40,000 files From: Tod Hopkins

2a.: Re: More on extended-ASCII characters in Mail app From: Tod Hopkins

View All Topics | Create New Topic

Messages

1a.: Re: Mass File Copy Problems, 40,000 files

Posted by: "Alan Fry" ajf@afco.demon.co.uk alanjohnfry

Tue Jan 31, 2012 2:03 am (PST)

On 30 Jan 2012, at 21:32, Tod Hopkins wrote:

> I'm having bunches of fun trying to copy roughly 40,000 files...
>
> FAT32 formatted external drive with 40,000 files in two folders. All files are identical 7.8MB files (image sequence). I am trying to move the files from one folder to a new folder (organizing) on the same drive but I have similar results trying to copy the files from the FAT32 drive to my internal drive.
>

I would try one or two file transfers with 'cp' to test whether or not 'cp' can cope with files to/from a FAT32 drive. If it does work you could do batch transfers with a script. That way you would get a error thrown if one of the files fails to copy, which could be handled appropriately to avoid the whole process grinding to a halt. For what its worth CCC uses 'cp' in a Perl script I believe.

Alan Fry

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (10)
1b.: Re: Mass File Copy Problems, 40,000 files

Posted by: "Alan Fry" ajf@afco.demon.co.uk alanjohnfry

Tue Jan 31, 2012 2:44 am (PST)

This article <http://reviews.cnet.com/8301-13727_7-10412974-263.html> suggests Finder has a problem copying from Fat32 to Fat32 (due to a Finder bug) but that 'cp' and 'mv' both work.

HTH

Alan Fry

On 30 Jan 2012, at 21:32, Tod Hopkins wrote:

> I'm having bunches of fun trying to copy roughly 40,000 files...
>
> FAT32 formatted external drive with 40,000 files in two folders. All files are identical 7.8MB files (image sequence). I am trying to move the files from one folder to a new folder (organizing) on the same drive but I have similar results trying to copy the files from the FAT32 drive to my internal drive.
>

I would try one or two file transfers with 'cp' to test whether or not 'cp' can cope with files to/from a FAT32 drive. If it does work you could do batch transfers with a script. That way you would get a error thrown if one of the files fails to copy, which could be handled appropriately to avoid the whole process grinding to a halt. For what its worth CCC uses 'cp' in a Perl script I believe.

Alan Fry

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (10)
1c.: Re: Mass File Copy Problems, 40,000 files

Posted by: "Katie Clark" ktclark16@yahoo.com.au ktclark16

Tue Jan 31, 2012 4:02 am (PST)

Hi everyone,

My name's Katie and I'm new to the group but I've read loads of the emails I get from you guys daily and I'm glad to see you are as passionate about your iPad as I am. I've only had it a few weeks as it was a Christmas pressie but I've picked up so many tips on things I can do thanks to you guys. As a thank you back I came across this website where you can win a new iPad 2 (and even an iPad 3! … when it comes out) and I thought you might be interested. To enter it takes just a few seconds. Good luck!
http://freestuff.robertjohn.co.uk/?page_id=8

________________________________
From: Alan Fry <ajf@afco.demon.co.uk>
To: macsupportcentral@yahoogroups.com
Sent: Tuesday, 31 January 2012 8:43 PM
Subject: Re: [macsupport] Mass File Copy Problems, 40,000 files

This article <http://reviews.cnet.com/8301-13727_7-10412974-263.html> suggests Finder has a problem copying from Fat32 to Fat32 (due to a Finder bug) but that 'cp' and 'mv' both work.

HTH

Alan Fry

On 30 Jan 2012, at 21:32, Tod Hopkins wrote:

> I'm having bunches of fun trying to copy roughly 40,000 files...
>
> FAT32 formatted external drive with 40,000 files in two folders. All files are identical 7.8MB files (image sequence). I am trying to move the files from one folder to a new folder (organizing) on the same drive but I have similar results trying to copy the files from the FAT32 drive to my internal drive.
>

I would try one or two file transfers with 'cp' to test whether or not 'cp' can cope with files to/from a FAT32 drive. If it does work you could do batch transfers with a script. That way you would get a error thrown if one of the files fails to copy, which could be handled appropriately to avoid the whole process grinding to a halt. For what its worth CCC uses 'cp' in a Perl script I believe.

Alan Fry

[Non-text portions of this message have been removed]

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (10)
1d.: Re: Mass File Copy Problems, 40,000 files

Posted by: "Tod Hopkins" hoplist@hillmanncarr.com todhop

Tue Jan 31, 2012 4:43 am (PST)

Interesting article as it suggests (not surprisingly) that Finder does have problems with FAT32, but my issues don't fit that bug in several ways: not copying folders, no error thrown, and has same problem from FAT32 to HFS+ drive.

Also not a space problem. There is a file number limit in FAT32 (~16,000 per folder I think) but I'm not approaching that in the destination folder. However, the original foldersdo, and the problem might lie in that limit with Finder attempting to rewrite the original directories. But if that were the case, you'd think it would get better as more files are removed from the original directory, and that's not happening. My last copy was 2100 files, and it jammed to a halt just over half way. And I mean dead cold stop. Oddly, Finder does not stop responding, but the CPU remains at 100% (half total) and just sits there and no further copying happens. I can stop it (though that takes a few minutes as well) and everything looks fine at that point, except the CPU remains active... usually. Sometimes it stops. If not, I have to unmount the drive to get the CPU back.

I presume "cp" is the unix copy command? I should definitely try that and see what the result is. Can't cp take wildcards or maybe a range? I'll need to look up the syntax. Anyone know a file manager that works at the system level, avoiding Finder?

Cheers,
tod

On Jan 31, 2012, at 5:43 AM, Alan Fry wrote:

> This article <http://reviews.cnet.com/8301-13727_7-10412974-263.html> suggests Finder has a problem copying from Fat32 to Fat32 (due to a Finder bug) but that 'cp' and 'mv' both work.
>
> HTH
>
> Alan Fry
>
> On 30 Jan 2012, at 21:32, Tod Hopkins wrote:
>
> > I'm having bunches of fun trying to copy roughly 40,000 files...
> >
> > FAT32 formatted external drive with 40,000 files in two folders. All files are identical 7.8MB files (image sequence). I am trying to move the files from one folder to a new folder (organizing) on the same drive but I have similar results trying to copy the files from the FAT32 drive to my internal drive.
> >
>
> I would try one or two file transfers with 'cp' to test whether or not 'cp' can cope with files to/from a FAT32 drive. If it does work you could do batch transfers with a script. That way you would get a error thrown if one of the files fails to copy, which could be handled appropriately to avoid the whole process grinding to a halt. For what its worth CCC uses 'cp' in a Perl script I believe.
>
> Alan Fry
>
> [Non-text portions of this message have been removed]
>
>

Tod Hopkins
Hillmann & Carr Inc.
todhopkins@hillmanncarr.com

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (10)

2a.: Re: More on extended-ASCII characters in Mail app

Posted by: "Tod Hopkins" hoplist@hillmanncarr.com todhop

Tue Jan 31, 2012 4:48 am (PST)

What does mail send if one chooses "plain text" with encoding set to automatic? Shouldn't it still send UTF-8 or does it fall back to a "simpler"character set, presumably Western Latin or whatever is appropriate to the language setting of the system?

Cheers,
tod

On Jan 31, 2012, at 4:46 AM, Alan Fry wrote:

>
> On 29 Jan 2012, at 07:37, Oneal Neumann wrote:
>
> >
> >> On 2012 January 27 (at 05:53) Alan Fry wrote:
> >>
> >> It may be that HAL9000 has Mail.app set to compose in 'Plain Text' rather than 'Rich Text'? I am sending this message in 'Rich Text' which should ensure that it is encoded to UTF-8 and thus it should avoid these ambiguities. We shall see.
> >>
> >> I hope raising this topic again is not boring, but it does seem to me important that Apple's Mail app should be able to handle nonASCII characters reliably and consistently. That is, after all, the aim of UTF-8. If it cannot, then I think it should be brought to Apple's attention. Alan Fry
> >>
> >
> > Mail > Message > Text Encoding presumably effects incoming emails, however selecting UTF-8 seems to do nothing ameliorate incoming weirdnesses.
> >
> > With respect to email composition, I�ve chosen Rich Text as my default form. There seems to be no way to affect Text Encoding in composition.
>
> No, it is actually the other way round, Mail->Message->Text sets the character encoding for composing the message. If you leave it set to 'Automatic' and use 'Rich Text', Mail.app will always choose utf-8. which is the best option. The only reason for setting something else would be if you >know< the recipient cannot handle utf-8 and needs a specific character encoding.
>
> You are quite right that there is no way to alter either 'Content-Type' or 'Content-Type-Encoding'. Mail makes those choices based on the content it finds in the message. With 'Rich Text' and utf-8 set Mail.app mostly (but not always) chooses 'text/plain' and 'quoted-printable' respectively. Usually extended ASCII characters travel intact.
>
> Alan Fry
>
>

Tod Hopkins
Hillmann & Carr Inc.
todhopkins@hillmanncarr.com

[Non-text portions of this message have been removed]

Back to top
Reply to sender | Reply to group | Reply via web post
Messages in this topic (5)