Home
Posted By: artie505 Anomalous "Restore" results? - 06/22/10 07:44 AM
I just restored my SL volume to an empty volume (with the "Erase...." box checked), and the sizes of the source and restored volumes are wildly different. (I got almost identical results from a second try.)

Source volume:
Code:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
 40K	/.fseventsd
 31M	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
882M	/Applications
3.9M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.5G	/Library
1.0K	/net
  0B	/Network
729M	/private
2.6M	/sbin
1.7G	/System
184M	/Users
379M	/usr
4.0K	/Volumes
5.3G	/
Artie-s-Computer-4:~ artie$

Restored volume:
Code:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
336K	/.fseventsd
 37M	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
964M	/Applications
9.0M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.6G	/Library
1.0K	/net
  0B	/Network
203M	/private
6.8M	/sbin
3.3G	/System
184M	/Users
935M	/usr
4.0K	/Volumes
7.2G	/
Artie-s-Computer-4:~ artie$

Does that Terminal output make any sense to anybody, or do I just not particularly understand what I did?

Thanks.
Posted By: dkmarsh Re: Anomalous "Restore" results? - 06/22/10 05:23 PM

Is there a significant capacity difference between the source and destination volumes? I'm wondering if the source is using smaller allocation blocks, and therefore wasting less space.
Posted By: Virtual1 Re: Anomalous "Restore" results? - 06/22/10 08:03 PM
almost certainly an allocation block size difference.

Make a small file. As in, open text edit and make a one word text file. Save it on one volume and copy to the other. compare file sizes.
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/23/10 05:08 PM
I know that a "restore" (assuming that means Disk Utility) does intentionally skip some stuff... but those results look bizarre. A few years ago i'd be inclined to go with allocation block size as well... but i'm not so sure now (i've never seen an OSX volume that wasn't 4KB).

Artie should tell us about these two disks (format, etc.), perhaps with

diskutil info /Volumes/*

...or something. [i.e., replace the asterisk with the real name]

I looked briefly for some command that shows allocation block size, but i don't find anything handy. [it might need to be scripted.]

--

I'd almost be inclined to think either one disk is not HFS+ journaled, or it needs repair.



Late EDIT:

Quote:
>> $ sudo du -xhd1 /
:
>> 4.0K /Volumes
:

The identical 4k size for both /Volumes folders seems to rule out the allocation block theory. [that 4k is probably the symlink to / which usually takes a single byte ("/"), therefore consuming a single allocation block.]

If both volumes pass muster with Disk Utility (or preferably DiskWarrior), then some method of determining the file differences is the way to go. A GUI folder sync with a preview feature (such as ChronoSync) could display what items differ (in just the two /sbin folders for example). Or a command line attempt might look like:

sudo diff -qr /Volumes/source/sbin/ /Volumes/restore/sbin/ |grep '^Only in'

The grep is just to skip over files which do exist on both sides, but have different contents. [other tools such as rsync -nrxv --delete could also be used, if done with care (i.e., do not remove the -n). But again, rsync will also display any files which exist on both sides, but have different contents (unless there's an option i'm not familiar with... in fact i bet there is one, so i'll look for it). Meanwhile, go with diff or a GUI folder sync utility.]


Posted By: dkmarsh Re: Anomalous "Restore" results? - 06/24/10 01:33 AM

Kind of interesting that /Users weighs in at the same 184 MB on each volume.
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/24/10 01:39 AM
Sure is. It would appear that Artie has found another SL bug of some sort.

Perhaps the "Erase" option malfunctioned... in a weird way.
Posted By: dkmarsh Re: Anomalous "Restore" results? - 06/24/10 02:18 AM
Originally Posted By: Hal Itosis
The identical 4k size for both /Volumes folders seems to rule out the allocation block theory. [that 4k is probably the symlink to / which usually takes a single byte ("/"), therefore consuming a single allocation block.]

Hmm, but then what about the 1.0K for /home and /net? (FWIW, when I run the command, I get both of those, plus 512B for /dev.)

If a single-byte file consumes a full allocation block, wouldn't a 512-byte or 1024-byte file likewise consume a full allocation block? Or am I not understanding what you're saying?
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/24/10 03:20 PM
/home and /net are some strange (synthetic) filesystems unto themselves. They represent some sort of networked "autofs" stuff which isn't part of the normal (physical) HFS+.

[i don't know enough to explain it any better.]



/dev is also an oddball. If i attack it directly, it gives me:

sudo du -xhd1 /dev
du: Can't follow symlink cycle from /dev/fd/3 to /dev/fd/3
Posted By: artie505 Re: Anomalous "Restore" results? - 06/25/10 07:02 AM
Originally Posted By: Virtual1
almost certainly an allocation block size difference.
Make a small file. As in, open text edit and make a one word text file. Save it on one volume and copy to the other. compare file sizes.

Identical!

(I've never heard of different sized allocation blocks in different volumes; I thought 4k was default...standard...carved in stone...unless willfully changed by a user, of course.)
Posted By: artie505 Re: Anomalous "Restore" results? - 06/25/10 07:04 AM
Originally Posted By: dkmarsh

Is there a significant capacity difference between the source and destination volumes? I'm wondering if the source is using smaller allocation blocks, and therefore wasting less space.

Nope... I'm restoring a 25Gb volume with about 6.5Gb used to a 15Gb volume.
Posted By: artie505 Re: Anomalous "Restore" results? - 06/25/10 07:23 AM
Here're the results of running your two commands:

Code:
Last login: Fri Jun 25 04:05:13 on ttys000
Artie-s-Computer-4:~ artie$ diskutil info /Volumes/HD
   Device Identifier:        disk0s2
   Device Node:              /dev/disk0s2
   Part Of Whole:            disk0
   Device / Media Name:      Untitled

   Volume Name:              HD
   Escaped with Unicode:     HD

   Mounted:                  Yes
   Mount Point:              /
   Escaped with Unicode:     /

   File System:              Journaled HFS+
   Type:                     hfs
   Name:                     Mac OS Extended (Journaled)
   Journal:                  Journal size 8192 KB at offset 0xca000
   Owners:                   Enabled

   Partition Type:           Apple_HFS
   Bootable:                 Is bootable
   Media Type:               Generic
   Protocol:                 SATA
   SMART Status:             Verified
   Volume UUID:              CAD72368-C0A0-36E4-B673-5E7A31C07396

   Total Size:               26.8 GB (26843545600 Bytes) (exactly 52428800 512-Byte-Blocks)
   Volume Free Space:        20.4 GB (20357443584 Bytes) (exactly 39760632 512-Byte-Blocks)

   Read-Only Media:          No
   Read-Only Volume:         No
   Ejectable:                No

   Whole:                    No
   Internal:                 Yes

Last login: Fri Jun 25 04:15:58 on ttys000
Artie-s-Computer-4:~ artie$ diskutil info /Volumes/HDx
   Device Identifier:        disk0s4
   Device Node:              /dev/disk0s4
   Part Of Whole:            disk0
   Device / Media Name:      Untitled

   Volume Name:              HDx
   Escaped with Unicode:     HDx

   Mounted:                  Yes
   Mount Point:              /Volumes/HDx
   Escaped with Unicode:     /Volumes/HDx

   File System:              Journaled HFS+
   Type:                     hfs
   Name:                     Mac OS Extended (Journaled)
   Journal:                  Journal size 8192 KB at offset 0x7a000
   Owners:                   Enabled

   Partition Type:           Apple_HFS
   Bootable:                 Is bootable
   Media Type:               Generic
   Protocol:                 SATA
   SMART Status:             Verified
   Volume UUID:              2EAC946F-FA02-3E98-8BD3-B6F9C5DA3786

   Total Size:               16.1 GB (16106127360 Bytes) (exactly 31457280 512-Byte-Blocks)
   Volume Free Space:        8.0 GB (8035516416 Bytes) (exactly 15694368 512-Byte-Blocks)

   Read-Only Media:          No
   Read-Only Volume:         No
   Ejectable:                No

   Whole:                    No
   Internal:                 Yes

Artie-s-Computer-4:~ artie$ 

and

Code:
Artie-s-Computer-4:~ artie$ sudo diff -qr /Volumes/source/sbin/ /Volumes/restore/sbin/ |grep '^Only in'
diff: /Volumes/source/sbin/: No such file or directory
diff: /Volumes/restore/sbin/: No such file or directory
Artie-s-Computer-4:~ artie$ -

Posted By: artie505 Re: Anomalous "Restore" results? - 06/25/10 08:08 AM
Originally Posted By: Hal Itosis
Sure is. It would appear that Artie has found another SL bug of some sort.

Perhaps the "Erase" option malfunctioned... in a weird way.

This is 100% reproducible, and with comparable, if not identical, results. (There are, invariably, huge, almost identical, differences in /System and /usr and smaller differences elsewhere.)

As a benchmark, I booted into 10.5.7 and ran a restore (Has restoring always changed the name of the destination volume to that of the source volume? ...extremely confusing!!!) with these results:

Code:
Source:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
 32K	/.fseventsd
 17M	/.Spotlight-V100
  0B	/.TemporaryItems
  0B	/.Trashes
  0B	/.vol
976M	/Applications
7.4M	/bin
  0B	/cores
512B	/dev
1.0K	/home
1.8G	/Library
1.0K	/net
  0B	/Network
564M	/private
5.2M	/sbin
2.6G	/System
1.1G	/Users
949M	/usr
 12K	/Volumes
8.1G	/
Artie-s-Computer-4:~ artie$

and

Code:
Destination:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
280K	/.fseventsd
 18M	/.Spotlight-V100
  0B	/.TemporaryItems
  0B	/.Trashes
  0B	/.vol
976M	/Applications
7.4M	/bin
  0B	/cores
512B	/dev
1.0K	/home
1.8G	/Library
1.0K	/net
  0B	/Network
321M	/private
5.2M	/sbin
2.6G	/System
1.1G	/Users
949M	/usr
4.0K	/Volumes
7.8G	/
Artie-s-Computer-4:~ artie$ 

I then looked deeper into /System and /usr in the source and destination volumes of my initial post (I've got the entire volumes' output if anybody cares to see it.) with these results:

Code:
Source:
Artie-s-Computer-4:~ artie$ sudo du -xhd2 /System
1.5M	/System/Library/Address Book Plug-Ins
5.9M	/System/Library/Automator
8.0K	/System/Library/BridgeSupport
 24M	/System/Library/Caches
836K	/System/Library/CFMSupport
308K	/System/Library/ColorPickers
  0B	/System/Library/Colors
220K	/System/Library/ColorSync
9.5M	/System/Library/Components
 44M	/System/Library/Compositions
103M	/System/Library/CoreServices
172K	/System/Library/DirectoryServices
  0B	/System/Library/Displays
  0B	/System/Library/DTDs
271M	/System/Library/Extensions
3.5M	/System/Library/Filesystems
112K	/System/Library/Filters
152M	/System/Library/Fonts
645M	/System/Library/Frameworks
1.1M	/System/Library/Graphics
3.0M	/System/Library/Image Capture
 36M	/System/Library/Input Methods
10.0M	/System/Library/Java
340K	/System/Library/KerberosPlugins
472K	/System/Library/Keyboard Layouts
520K	/System/Library/Keychains
4.0K	/System/Library/LaunchAgents
  0B	/System/Library/LaunchDaemons
692K	/System/Library/LoginPlugins
 32K	/System/Library/Modem Scripts
448K	/System/Library/MonitorPanels
  0B	/System/Library/OpenSSL
 48M	/System/Library/Perl
384K	/System/Library/PodcastProducer
 30M	/System/Library/PreferencePanes
1.2M	/System/Library/Printers
221M	/System/Library/PrivateFrameworks
452K	/System/Library/QuickLook
 43M	/System/Library/QuickTime
 48K	/System/Library/QuickTimeJava
  0B	/System/Library/Sandbox
 35M	/System/Library/Screen Savers
712K	/System/Library/ScreenReader
620K	/System/Library/ScriptingAdditions
  0B	/System/Library/ScriptingDefinitions
1.2M	/System/Library/Security
3.3M	/System/Library/Services
700K	/System/Library/Sounds
2.1M	/System/Library/Speech
1.0M	/System/Library/Spelling
556K	/System/Library/Spotlight
  0B	/System/Library/StartupItems
228K	/System/Library/SyncServices
1.6M	/System/Library/SystemConfiguration
1.1M	/System/Library/SystemProfiler
 12M	/System/Library/Tcl
132K	/System/Library/TextEncodings
1.0M	/System/Library/User Template
356K	/System/Library/UserEventPlugins
144K	/System/Library/WidgetResources
1.7G	/System/Library
1.7G	/System
Artie-s-Computer-4:~ artie$ 

and

Code:
Destination:
Artie-s-Computer-4:~ artie$ sudo du -xhd2 /System
Password:
3.3M	/System/Library/Address Book Plug-Ins
 24M	/System/Library/Automator
 28K	/System/Library/BridgeSupport
 30M	/System/Library/Caches
836K	/System/Library/CFMSupport
456K	/System/Library/ColorPickers
 24K	/System/Library/Colors
528K	/System/Library/ColorSync
 19M	/System/Library/Components
 45M	/System/Library/Compositions
162M	/System/Library/CoreServices
1.2M	/System/Library/DirectoryServices
912K	/System/Library/Displays
 28K	/System/Library/DTDs
271M	/System/Library/Extensions
5.2M	/System/Library/Filesystems
268K	/System/Library/Filters
204M	/System/Library/Fonts
1.6G	/System/Library/Frameworks
2.3M	/System/Library/Graphics
7.9M	/System/Library/Image Capture
111M	/System/Library/Input Methods
 18M	/System/Library/Java
896K	/System/Library/KerberosPlugins
1.5M	/System/Library/Keyboard Layouts
904K	/System/Library/Keychains
276K	/System/Library/LaunchAgents
640K	/System/Library/LaunchDaemons
2.2M	/System/Library/LoginPlugins
 72K	/System/Library/Modem Scripts
1.4M	/System/Library/MonitorPanels
 40K	/System/Library/OpenSSL
159M	/System/Library/Perl
716K	/System/Library/PodcastProducer
 44M	/System/Library/PreferencePanes
2.8M	/System/Library/Printers
465M	/System/Library/PrivateFrameworks
1.1M	/System/Library/QuickLook
 57M	/System/Library/QuickTime
152K	/System/Library/QuickTimeJava
8.0K	/System/Library/Sandbox
 35M	/System/Library/Screen Savers
2.7M	/System/Library/ScreenReader
1.7M	/System/Library/ScriptingAdditions
 12K	/System/Library/ScriptingDefinitions
3.9M	/System/Library/Security
5.7M	/System/Library/Services
924K	/System/Library/Sounds
5.2M	/System/Library/Speech
4.2M	/System/Library/Spelling
1.8M	/System/Library/Spotlight
  0B	/System/Library/StartupItems
836K	/System/Library/SyncServices
4.1M	/System/Library/SystemConfiguration
4.2M	/System/Library/SystemProfiler
 40M	/System/Library/Tcl
584K	/System/Library/TextEncodings
1.1M	/System/Library/User Template
1.2M	/System/Library/UserEventPlugins
336K	/System/Library/WidgetResources
3.3G	/System/Library
3.3G	/System
Artie-s-Computer-4:~ artie$ 

also

Code:
Source:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /usr
 93M	/usr/bin
 68M	/usr/lib
 34M	/usr/libexec
1.0M	/usr/local
 39M	/usr/sbin
140M	/usr/share
 15M	/usr/standalone
768K	/usr/X11
392M	/usr
Artie-s-Computer-4:~ artie$ sudo du -xhd2 /usr
 93M	/usr/bin
 12K	/usr/lib/dtrace
 36K	/usr/lib/groff
 16K	/usr/lib/info
 24K	/usr/lib/java
  0B	/usr/lib/libxslt-plugins
 18M	/usr/lib/mecab
1.6M	/usr/lib/openmpi
244K	/usr/lib/pam
608K	/usr/lib/php
  0B	/usr/lib/pkgconfig
104K	/usr/lib/podcastproducer
 20K	/usr/lib/sa
5.8M	/usr/lib/samba
932K	/usr/lib/sasl2
132K	/usr/lib/system
1.2M	/usr/lib/zsh
 68M	/usr/lib
 13M	/usr/libexec/apache2
 60K	/usr/libexec/APNBridge
144K	/usr/libexec/ApplicationFirewall
  0B	/usr/libexec/changeip
2.6M	/usr/libexec/cups
136K	/usr/libexec/emacs
8.0K	/usr/libexec/fax
 24K	/usr/libexec/MiniTerm.app
2.3M	/usr/libexec/oah
180K	/usr/libexec/podcastproducer
7.1M	/usr/libexec/postfix
268K	/usr/libexec/samba
276K	/usr/libexec/SmartCardServices
 64K	/usr/libexec/xgrid
 34M	/usr/libexec
1.0M	/usr/local/hermes
1.0M	/usr/local
 39M	/usr/sbin
  0B	/usr/share/aclocal
 60K	/usr/share/apr-1
8.0K	/usr/share/bakefile
 84K	/usr/share/calendar
616K	/usr/share/cracklib
1.1M	/usr/share/cups
1.1M	/usr/share/dict
5.8M	/usr/share/doc
 28M	/usr/share/emacs
324K	/usr/share/enscript
  0B	/usr/share/examples
232K	/usr/share/file
  0B	/usr/share/ftpd
2.1M	/usr/share/germantok
1.0M	/usr/share/groff
  0B	/usr/share/gtk-doc
6.9M	/usr/share/gutenprint
8.0K	/usr/share/hiutil
908K	/usr/share/httpd
 11M	/usr/share/icu
5.0M	/usr/share/info
 14M	/usr/share/java
2.0M	/usr/share/langid
8.0K	/usr/share/libiodbc
 10M	/usr/share/locale
 42M	/usr/share/man
  0B	/usr/share/mecab
 32K	/usr/share/misc
 24K	/usr/share/NotificationServer
4.0K	/usr/share/openmpi
 24K	/usr/share/podcastproducer
  0B	/usr/share/sandbox
272K	/usr/share/screen
 12K	/usr/share/servermgrd
  0B	/usr/share/skel
416K	/usr/share/snmp
124K	/usr/share/swig
  0B	/usr/share/tabset
8.0K	/usr/share/TargetConfigs
8.0K	/usr/share/tcsh
  0B	/usr/share/terminfo
272K	/usr/share/texi2html
8.0K	/usr/share/texinfo
  0B	/usr/share/uucp
5.7M	/usr/share/vim
 12K	/usr/share/zoneinfo
304K	/usr/share/zsh
140M	/usr/share
 15M	/usr/standalone/i386
 15M	/usr/standalone
768K	/usr/X11/share
768K	/usr/X11
392M	/usr
Artie-s-Computer-4:~ artie$ 

and

Code:
Destination:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /usr
238M	/usr/bin
224M	/usr/lib
 85M	/usr/libexec
1.0M	/usr/local
 98M	/usr/sbin
275M	/usr/share
 15M	/usr/standalone
768K	/usr/X11
937M	/usr
Artie-s-Computer-4:~ artie$ sudo du -xhd2 /usr
238M	/usr/bin
104K	/usr/lib/dtrace
140K	/usr/lib/groff
 64K	/usr/lib/info
 88K	/usr/lib/java
  0B	/usr/lib/libxslt-plugins
 94M	/usr/lib/mecab
5.1M	/usr/lib/openmpi
1008K	/usr/lib/pam
3.1M	/usr/lib/php
 48K	/usr/lib/pkgconfig
888K	/usr/lib/podcastproducer
 80K	/usr/lib/sa
 16M	/usr/lib/samba
2.5M	/usr/lib/sasl2
304K	/usr/lib/system
3.4M	/usr/lib/zsh
224M	/usr/lib
 36M	/usr/libexec/apache2
160K	/usr/libexec/APNBridge
416K	/usr/libexec/ApplicationFirewall
4.0K	/usr/libexec/changeip
6.2M	/usr/libexec/cups
624K	/usr/libexec/emacs
 24K	/usr/libexec/fax
104K	/usr/libexec/MiniTerm.app
3.0M	/usr/libexec/oah
524K	/usr/libexec/podcastproducer
 17M	/usr/libexec/postfix
740K	/usr/libexec/samba
736K	/usr/libexec/SmartCardServices
252K	/usr/libexec/xgrid
 85M	/usr/libexec
1.0M	/usr/local/hermes
1.0M	/usr/local
 98M	/usr/sbin
 32K	/usr/share/aclocal
236K	/usr/share/apr-1
 28K	/usr/share/bakefile
344K	/usr/share/calendar
1.3M	/usr/share/cracklib
6.3M	/usr/share/cups
3.4M	/usr/share/dict
 17M	/usr/share/doc
 64M	/usr/share/emacs
1.3M	/usr/share/enscript
240K	/usr/share/examples
2.8M	/usr/share/file
8.0K	/usr/share/ftpd
4.8M	/usr/share/germantok
3.7M	/usr/share/groff
  0B	/usr/share/gtk-doc
6.9M	/usr/share/gutenprint
 28K	/usr/share/hiutil
1.1M	/usr/share/httpd
 27M	/usr/share/icu
 16M	/usr/share/info
 15M	/usr/share/java
4.9M	/usr/share/langid
 32K	/usr/share/libiodbc
 15M	/usr/share/locale
 50M	/usr/share/man
4.0K	/usr/share/mecab
128K	/usr/share/misc
304K	/usr/share/NotificationServer
116K	/usr/share/openmpi
124K	/usr/share/podcastproducer
 84K	/usr/share/sandbox
316K	/usr/share/screen
 12K	/usr/share/servermgrd
  0B	/usr/share/skel
2.4M	/usr/share/snmp
3.0M	/usr/share/swig
 16K	/usr/share/tabset
 44K	/usr/share/TargetConfigs
 40K	/usr/share/tcsh
372K	/usr/share/terminfo
420K	/usr/share/texi2html
 32K	/usr/share/texinfo
 12K	/usr/share/uucp
 20M	/usr/share/vim
1.7M	/usr/share/zoneinfo
4.2M	/usr/share/zsh
275M	/usr/share
 15M	/usr/standalone/i386
 15M	/usr/standalone
768K	/usr/X11/share
768K	/usr/X11
937M	/usr
Artie-s-Computer-4:~ artie$ 

(It would be neat if there was a way to line up the two results side-by-side.)

I suppose the next logical step is for me to file a bug report with Apple, but I'll wait for additional feedback before doing so.
Posted By: dkmarsh Re: Anomalous "Restore" results? - 06/25/10 09:57 AM
Originally Posted By: artie505
Code:
Artie-s-Computer-4:~ artie$ sudo diff -qr /Volumes/source/sbin/ /Volumes/restore/sbin/ |grep '^Only in'
diff: /Volumes/source/sbin/: No such file or directory
diff: /Volumes/restore/sbin/: No such file or directory
Artie-s-Computer-4:~ artie$ -

I think you were meant to enter the actual names of the two volumes in place of source and restore. wink ("No such file or directory" is, in my limited experience, almost invariably a clue that a command has been entered incorrectly.)
Posted By: artie505 Re: Anomalous "Restore" results? - 06/25/10 10:34 AM
Thanks.

My initial reaction was "Duuuh!" (I'm truly brain-burned from this issue which, in one manner or another, has been going on for well over a month, now.)

But...

Code:
Artie-s-Computer-4:~ artie$ sudo diff -qr /Volumes/HD/sbin/ /Volumes/HDx/sbin/ |grep '^Only in'
Password:
Artie-s-Computer-4:~ artie$ 

I dunno? confused
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/25/10 04:07 PM
Originally Posted By: artie505
But...
Code:
Artie-s-Computer-4:~ artie$ sudo diff -qr /Volumes/HD/sbin/ /Volumes/HDx/sbin/ |grep '^Only in'
Password:
Artie-s-Computer-4:~ artie$ 

I dunno? confused

That's a surprising "difference". [i.e., none.]

Okay Artie-pants wink ... let's try this then:

ls -ago /Volumes/*/sbin


(also, the first command without the
grep filter should have output: diff -qr /Volumes/HD/sbin/ /Volumes/HDx/sbin/ —but, ls -ago /Volumes/*/sbin should be equally informative).


While we're at it, let's look at /bin as well (since it has less files and a bigger size discrepancy):

ls -ago /Volumes/*/bin


--

BTW, i'm wondering now if this all isn't simply due to SL's new "compressed storage" feature in HFS+. The boot volume maintains a compressed version... but a restore operation will expand the data onto the backup volume.

That would also explain why Finder's Get Info measurement is off as well:
$ du -hxd1 /sbin
2.6M /sbin

If i look at /sbin with a Finder Get Info window, it reports 7.5 megs.


Also... between /bin /sbin and /usr there are a fair amount of multi-linked files. I wonder to what extent that linkage gets preserved, or what may be copied over as multiple file instances. [we can check that if you like.]

Scratch multi-linked files... I think it's the compression mainly.
Posted By: artie505 Re: Anomalous "Restore" results? - 06/26/10 07:35 AM
Here ya go (although I'm not all certain where you're headed)...

Last login: Fri Jun 25 21:55:12 on ttys000
Artie-s-Computer-4:~ artie$ ls -ago /Volumes/*/sbin
/Volumes/HD/sbin:
total 5640
drwxr-xr-x@ 64 2176 Jun 21 05:44 .
drwxrwxr-t 31 1122 Jun 21 04:33 ..
-r-xr-xr-x 1 122016 Apr 9 19:17 SystemStarter
-rwxr-xr-x 1 31520 May 18 2009 autodiskmount
-r-xr-xr-x 1 50960 Apr 7 21:32 clri
-rwxr-xr-x 1 29424 May 18 2009 disklabel
-r-xr-xr-x 1 50752 Apr 23 21:48 dmesg
-r-xr-xr-x 2 148016 Apr 7 21:32 dump
-r-xr-xr-x 1 67440 Apr 7 21:32 dumpfs
-r-xr-xr-x 1 85456 Apr 23 21:48 dynamic_pager
-rwxr-xr-x 1 80800 May 19 2009 fibreconfig
-r-xr-xr-x 1 221056 Apr 7 21:32 fsck
-r-xr-xr-x 1 731040 Apr 7 21:33 fsck_hfs
-rwxr-xr-x 1 76880 Apr 23 21:38 fsck_msdos
-rwxr-xr-x 1 297968 Apr 23 22:40 fsck_udf
-r-xr-xr-x 1 50960 Apr 7 21:33 fstyp
-r-xr-xr-x 1 50992 Apr 7 21:33 fstyp_hfs
-r-xr-xr-x 1 51008 Apr 7 21:33 fstyp_msdos
-r-xr-xr-x 1 51008 Apr 7 21:33 fstyp_ntfs
-r-xr-xr-x 1 51024 Apr 7 21:33 fstyp_udf
-r-xr-xr-x 1 50944 Apr 7 21:33 fstyp_ufs
-r-xr-xr-x 2 55760 Apr 23 21:49 halt
-r-xr-xr-x 1 150960 Apr 7 21:50 ifconfig
-r-xr-xr-x 1 110080 Apr 7 21:51 ip6fw
-r-xr-xr-x 1 180224 Apr 7 21:51 ipfw
-rwxr-xr-x 1 183968 Oct 16 2009 kerberosautoconfig
-rwxr-xr-x 1 74240 Apr 23 21:54 kextload
-rwxr-xr-x 1 69504 Apr 23 21:54 kextunload
-r-xr-xr-x 1 623152 Apr 9 19:17 launchd
-r-xr-xr-x 1 65232 May 18 2009 md5
-r-xr-xr-x 1 39024 Jul 14 2009 mknod
-r-xr-xr-x 1 80768 Apr 7 21:33 mount
-rwxr-xr-x 1 63664 Feb 11 01:57 mount_afp
-rwxr-xr-x 1 44448 Apr 23 21:40 mount_cd9660
-r-xr-xr-x 2 85568 Apr 23 21:40 mount_cddafs
-r-xr-xr-x 1 50848 Apr 7 21:33 mount_devfs
-r-xr-xr-x 1 50960 Apr 7 21:33 mount_fdesc
lrwxr-xr-x 1 44 Jun 21 05:05 mount_ftp -> /System/Library/Filesystems/ftp.fs/mount_ftp
-r-xr-xr-x 1 85376 Apr 7 21:33 mount_hfs
-rwxr-xr-x 1 49632 Apr 23 21:37 mount_msdos
-r-sr-xr-x 1 111296 May 19 2009 mount_nfs
-rwxr-xr-x 1 35296 Apr 23 21:40 mount_ntfs
-r-xr-xr-x 1 367792 Apr 23 21:48 mount_smbfs
-rwxr-xr-x 1 173856 Apr 23 22:39 mount_udf
-rwxr-xr-x 1 34768 Apr 23 22:28 mount_webdav
-r-xr-xr-x 1 131104 Apr 7 21:33 newfs_hfs
-rwxr-xr-x 1 60752 Apr 23 21:38 newfs_msdos
-rwxr-xr-x 1 291232 Apr 23 22:39 newfs_udf
-r-xr-xr-x 1 304496 May 19 2009 nfsd
-r-xr-xr-x 1 50992 May 19 2009 nfsiod
-r-xr-xr-x 1 50656 Apr 23 21:49 nologin
-r-xr-xr-x 1 101312 Apr 7 21:51 ping
-r-xr-xr-x 1 139008 Apr 7 21:51 ping6
-r-xr-xr-x 1 97408 Apr 7 21:33 quotacheck
-r-xr-xr-x 2 148016 Apr 7 21:32 rdump
-r-xr-xr-x 2 55760 Apr 23 21:49 reboot
-r-xr-xr-x 2 213472 Apr 7 21:33 restore
-r-xr-xr-x 1 105776 Apr 7 21:51 route
-r-xr-xr-x 2 213472 Apr 7 21:33 rrestore
-r-xr-xr-x 1 101456 Apr 7 21:51 rtsol
-rwxr-xr-x 1 64272 May 18 2009 service
-r-xr-xr-x 1 85808 Apr 23 21:50 shutdown
-r-xr-xr-x 1 63392 Apr 7 21:33 tunefs
-r-xr-xr-x 1 64192 Apr 7 21:33 umount

/Volumes/HDx/sbin:
total 14728
drwxr-xr-x@ 64 2176 Jun 21 05:44 .
drwxrwxr-t 31 1122 Jun 24 02:25 ..
-r-xr-xr-x 1 122016 Apr 9 19:17 SystemStarter
-rwxr-xr-x 1 31520 May 18 2009 autodiskmount
-r-xr-xr-x 1 50960 Apr 7 21:32 clri
-rwxr-xr-x 1 29424 May 18 2009 disklabel
-r-xr-xr-x 1 50752 Apr 23 21:48 dmesg
-r-xr-xr-x 2 148016 Apr 7 21:32 dump
-r-xr-xr-x 1 67440 Apr 7 21:32 dumpfs
-r-xr-xr-x 1 85456 Apr 23 21:48 dynamic_pager
-rwxr-xr-x 1 80800 May 19 2009 fibreconfig
-r-xr-xr-x 1 221056 Apr 7 21:32 fsck
-r-xr-xr-x 1 731040 Apr 7 21:33 fsck_hfs
-rwxr-xr-x 1 76880 Apr 23 21:38 fsck_msdos
-rwxr-xr-x 1 297968 Apr 23 22:40 fsck_udf
-r-xr-xr-x 1 50960 Apr 7 21:33 fstyp
-r-xr-xr-x 1 50992 Apr 7 21:33 fstyp_hfs
-r-xr-xr-x 1 51008 Apr 7 21:33 fstyp_msdos
-r-xr-xr-x 1 51008 Apr 7 21:33 fstyp_ntfs
-r-xr-xr-x 1 51024 Apr 7 21:33 fstyp_udf
-r-xr-xr-x 1 50944 Apr 7 21:33 fstyp_ufs
-r-xr-xr-x 2 55760 Apr 23 21:49 halt
-r-xr-xr-x 1 150960 Apr 7 21:50 ifconfig
-r-xr-xr-x 1 110080 Apr 7 21:51 ip6fw
-r-xr-xr-x 1 180224 Apr 7 21:51 ipfw
-rwxr-xr-x 1 183968 Oct 16 2009 kerberosautoconfig
-rwxr-xr-x 1 74240 Apr 23 21:54 kextload
-rwxr-xr-x 1 69504 Apr 23 21:54 kextunload
-r-xr-xr-x 1 623152 Apr 9 19:17 launchd
-r-xr-xr-x 1 65232 May 18 2009 md5
-r-xr-xr-x 1 39024 Jul 14 2009 mknod
-r-xr-xr-x 1 80768 Apr 7 21:33 mount
-rwxr-xr-x 1 63664 Feb 11 01:57 mount_afp
-rwxr-xr-x 1 44448 Apr 23 21:40 mount_cd9660
-r-xr-xr-x 2 85568 Apr 23 21:40 mount_cddafs
-r-xr-xr-x 1 50848 Apr 7 21:33 mount_devfs
-r-xr-xr-x 1 50960 Apr 7 21:33 mount_fdesc
lrwxr-xr-x 1 44 Jun 24 02:07 mount_ftp -> /System/Library/Filesystems/ftp.fs/mount_ftp
-r-xr-xr-x 1 85376 Apr 7 21:33 mount_hfs
-rwxr-xr-x 1 49632 Apr 23 21:37 mount_msdos
-r-sr-xr-x 1 111296 May 19 2009 mount_nfs
-rwxr-xr-x 1 35296 Apr 23 21:40 mount_ntfs
-r-xr-xr-x 1 367792 Apr 23 21:48 mount_smbfs
-rwxr-xr-x 1 173856 Apr 23 22:39 mount_udf
-rwxr-xr-x 1 34768 Apr 23 22:28 mount_webdav
-r-xr-xr-x 1 131104 Apr 7 21:33 newfs_hfs
-rwxr-xr-x 1 60752 Apr 23 21:38 newfs_msdos
-rwxr-xr-x 1 291232 Apr 23 22:39 newfs_udf
-r-xr-xr-x 1 304496 May 19 2009 nfsd
-r-xr-xr-x 1 50992 May 19 2009 nfsiod
-r-xr-xr-x 1 50656 Apr 23 21:49 nologin
-r-xr-xr-x 1 101312 Apr 7 21:51 ping
-r-xr-xr-x 1 139008 Apr 7 21:51 ping6
-r-xr-xr-x 1 97408 Apr 7 21:33 quotacheck
-r-xr-xr-x 2 148016 Apr 7 21:32 rdump
-r-xr-xr-x 2 55760 Apr 23 21:49 reboot
-r-xr-xr-x 2 213472 Apr 7 21:33 restore
-r-xr-xr-x 1 105776 Apr 7 21:51 route
-r-xr-xr-x 2 213472 Apr 7 21:33 rrestore
-r-xr-xr-x 1 101456 Apr 7 21:51 rtsol
-rwxr-xr-x 1 64272 May 18 2009 service
-r-xr-xr-x 1 85808 Apr 23 21:50 shutdown
-r-xr-xr-x 1 63392 Apr 7 21:33 tunefs
-r-xr-xr-x 1 64192 Apr 7 21:33 umount
Artie-s-Computer-4:~ artie$
Artie-s-Computer-4:~ artie$
Artie-s-Computer-4:~ artie$
Artie-s-Computer-4:~ artie$ diff -qr /Volumes/HD/sbin/ /Volumes/HDx/sbin/
Artie-s-Computer-4:~ artie$
Artie-s-Computer-4:~ artie$
Artie-s-Computer-4:~ artie$
Artie-s-Computer-4:~ artie$ ls -ago /Volumes/*/bin
/Volumes/HD/bin:
total 8640
drwxr-xr-x@ 39 1326 Jun 21 05:44 .
drwxrwxr-t 31 1122 Jun 21 04:33 ..
-r-xr-xr-x 2 63184 May 18 2009 [
-rwxr-xr-x 1 1346544 Feb 11 00:44 bash
-r-xr-xr-x 1 44272 May 18 2009 cat
-r-xr-xr-x 1 62656 Jul 14 2009 chmod
-r-xr-xr-x 1 57632 Jul 14 2009 cp
-rwxr-xr-x 2 767200 Feb 11 00:54 csh
-r-xr-xr-x 1 80848 May 18 2009 date
-r-xr-xr-x 1 60992 Jul 14 2009 dd
-r-xr-xr-x 1 48368 Jul 14 2009 df
-r-xr-xr-x 1 50816 May 18 2009 domainname
-r-xr-xr-x 1 50704 May 18 2009 echo
-r-xr-xr-x 1 117504 May 18 2009 ed
-r-xr-xr-x 1 67552 May 18 2009 expr
-r-xr-xr-x 1 50816 May 18 2009 hostname
-r-xr-xr-x 1 51024 May 18 2009 kill
-r-xr-xr-x 1 2186880 May 19 2009 ksh
-r-xr-xr-x 1 246720 Apr 9 19:17 launchctl
-r-xr-xr-x 2 39552 Jul 14 2009 link
-r-xr-xr-x 2 39552 Jul 14 2009 ln
-r-xr-xr-x 1 80688 Jul 14 2009 ls
-r-xr-xr-x 1 35072 Jul 14 2009 mkdir
-r-xr-xr-x 1 44848 Jul 14 2009 mv
-r-xr-xr-x 1 238576 Jul 14 2009 pax
-r-sr-xr-x 1 134816 May 18 2009 ps
-r-xr-xr-x 1 50784 May 18 2009 pwd
-r-sr-xr-x 1 93376 May 18 2009 rcp
-r-xr-xr-x 2 44448 Jul 14 2009 rm
-r-xr-xr-x 1 34624 Jul 14 2009 rmdir
-r-xr-xr-x 1 1346624 Feb 11 00:47 sh
-r-xr-xr-x 1 50752 May 18 2009 sleep
-r-xr-xr-x 1 88704 May 18 2009 stty
-r-xr-xr-x 1 50512 Apr 23 21:50 sync
-rwxr-xr-x 2 767200 Feb 11 00:54 tcsh
-r-xr-xr-x 2 63184 May 18 2009 test
-r-xr-xr-x 2 44448 Jul 14 2009 unlink
-r-xr-xr-x 1 50864 Apr 9 19:17 wait4path
-rwxr-xr-x 1 1597200 May 11 2009 zsh

/Volumes/HDx/bin:
total 20144
drwxr-xr-x@ 39 1326 Jun 21 05:44 .
drwxrwxr-t 31 1122 Jun 24 02:25 ..
-r-xr-xr-x 2 63184 May 18 2009 [
-rwxr-xr-x 1 1346544 Feb 11 00:44 bash
-r-xr-xr-x 1 44272 May 18 2009 cat
-r-xr-xr-x 1 62656 Jul 14 2009 chmod
-r-xr-xr-x 1 57632 Jul 14 2009 cp
-rwxr-xr-x 2 767200 Feb 11 00:54 csh
-r-xr-xr-x 1 80848 May 18 2009 date
-r-xr-xr-x 1 60992 Jul 14 2009 dd
-r-xr-xr-x 1 48368 Jul 14 2009 df
-r-xr-xr-x 1 50816 May 18 2009 domainname
-r-xr-xr-x 1 50704 May 18 2009 echo
-r-xr-xr-x 1 117504 May 18 2009 ed
-r-xr-xr-x 1 67552 May 18 2009 expr
-r-xr-xr-x 1 50816 May 18 2009 hostname
-r-xr-xr-x 1 51024 May 18 2009 kill
-r-xr-xr-x 1 2186880 May 19 2009 ksh
-r-xr-xr-x 1 246720 Apr 9 19:17 launchctl
-r-xr-xr-x 2 39552 Jul 14 2009 link
-r-xr-xr-x 2 39552 Jul 14 2009 ln
-r-xr-xr-x 1 80688 Jul 14 2009 ls
-r-xr-xr-x 1 35072 Jul 14 2009 mkdir
-r-xr-xr-x 1 44848 Jul 14 2009 mv
-r-xr-xr-x 1 238576 Jul 14 2009 pax
-r-sr-xr-x 1 134816 May 18 2009 ps
-r-xr-xr-x 1 50784 May 18 2009 pwd
-r-sr-xr-x 1 93376 May 18 2009 rcp
-r-xr-xr-x 2 44448 Jul 14 2009 rm
-r-xr-xr-x 1 34624 Jul 14 2009 rmdir
-r-xr-xr-x 1 1346624 Feb 11 00:47 sh
-r-xr-xr-x 1 50752 May 18 2009 sleep
-r-xr-xr-x 1 88704 May 18 2009 stty
-r-xr-xr-x 1 50512 Apr 23 21:50 sync
-rwxr-xr-x 2 767200 Feb 11 00:54 tcsh
-r-xr-xr-x 2 63184 May 18 2009 test
-r-xr-xr-x 2 44448 Jul 14 2009 unlink
-r-xr-xr-x 1 50864 Apr 9 19:17 wait4path
-rwxr-xr-x 1 1597200 May 11 2009 zsh
Artie-s-Computer-4:~ artie$

Edit: As I mentioned in my keychain thread, I'm going to do an erase and install; maybe it will clear up this issue (too, hopefully).

I won't do it, though, until you're done investigating...soon, I hope.
Posted By: dkmarsh Re: Anomalous "Restore" results? - 06/26/10 10:55 AM

Quote:
...I'm not all certain where you're headed...

Well, it's a comparison of the number and size of items in /sbin and /bin on the source with the number and size of items in /sbin and /bin on the clone. As far as I can tell, they're identical.

Yet the number of 512-byte blocks used by those files is wildly different between the source and the clone:

Quote:
/Volumes/HD/sbin:
total 5640

/Volumes/HDx/sbin:
total 14728

/Volumes/HD/bin:
total 8640

/Volumes/HDx/bin:
total 20144


So somehow, identically-sized files are occupying a larger number of blocks on the clone.

Originally Posted By: Hal Itosis
BTW, i'm wondering now if this all isn't simply due to SL's new "compressed storage" feature in HFS+. The boot volume maintains a compressed version... but a restore operation will expand the data onto the backup volume.

This stuff is largely over my head, but a perusal of the Installation page from Mac OS X 10.6 Snow Leopard: the Ars Technica review provides some interesting details about Snowy's compression techniques, including this tidbit:

Originally Posted By: John Siracusa
You may be wondering, if this is all about data compression, how does storing eight uncompressed bytes plus a 17-byte preamble in an extended attribute save any disk space? The answer to that lies in how HFS+ allocates disk space. When storing information in a data or resource fork, HFS+ allocates space in multiples of the file system's allocation block size (4 KB, by default). So those eight bytes will take up a minimum of 4,096 bytes if stored in the traditional way. When allocating disk space for extended attributes, however, the allocation block size is not a factor; the data is packed in much more tightly. In the end, the actual space saved by storing those 25 bytes of data in an extended attribute is over 4,000 bytes.

I wonder if the expansion of the compressed data is occurring because the restore operation is making a file-level copy of the source rather than a block-level copy? (Since your target was smaller than your source, a block-level copy wouldn't have been possible; also, you'd've needed to be booted from a third volume, since both source and target need to be unmountable for a block-level copy using ASR.) (Which leads to the following question: were you booted from a third volume? If so, was it a Leopard volume?)
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/26/10 06:58 PM
Pretty sneaky too how the extended attributes are all hidden when viewed in Snow Leopard.
[not a single item above listed with ls shows any "@" at the end of the permissions string.]
Posted By: CharlesS Re: Anomalous "Restore" results? - 06/27/10 05:44 AM
Artie, if I remember right, when you ran that tool I gave you earlier to check if files were compressed or not, it turned up "not compressed" for all the files you ran it on for the volume cloned using Restore, right?

If my memory's right, then that's all this is. The original files were compressed, the cloned ones aren't. The restore tool simply didn't preserve the compression, which isn't surprising, since it's probably just copying the files, and the way the HFS+ driver works in SL, if you copy a compressed file, it doesn't compress the result.

It's non-ideal, but it's still better than the custom Bombich rsync that backuplist+ uses, which tries to preserve the HFS compression, but apparently is prone to messing it up and corrupting the whole file.

The best way to avoid all these sorts of problems is always to click the "Erase Destination" check box when cloning. When using the Restore tab, this will often result in a block copy, which is pretty much guaranteed to be exactly the same as the original.
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/27/10 05:11 PM
Quote:
It's non-ideal, but it's still better than the custom Bombich rsync that backuplist+ uses, which tries to preserve the HFS compression, but apparently is prone to messing it up and corrupting the whole file.

For those who may be curious (as i was), more on Bombich's patch here: rsync and hfs+ compressed files damaged
Posted By: artie505 Re: Anomalous "Restore" results? - 06/28/10 09:42 AM
You're correct about /sbin and /usr, Charles, but what about /System?

Code:
Artie-s-Computer-4:~ artie$ /Volumes/HD2/3rd\ Party\ Stuff/Apps/Pacifist/hfs_comp_tool /system/library/*
File /system/library/Address Book Plug-Ins is not compressed
File /system/library/Automator is not compressed
File /system/library/BridgeSupport is not compressed
File /system/library/CFMSupport is not compressed
File /system/library/Caches is not compressed
File /system/library/ColorPickers is not compressed
File /system/library/ColorSync is not compressed
File /system/library/Colors is not compressed
File /system/library/Components is not compressed
File /system/library/Compositions is not compressed
File /system/library/CoreServices is not compressed
File /system/library/DTDs is not compressed
File /system/library/DirectoryServices is not compressed
File /system/library/Displays is not compressed
File /system/library/Extensions is not compressed
File /system/library/Filesystems is not compressed
File /system/library/Filters is not compressed
File /system/library/Fonts is not compressed
File /system/library/Frameworks is not compressed
File /system/library/Graphics is not compressed
File /system/library/Image Capture is not compressed
File /system/library/Input Methods is not compressed
File /system/library/Java is not compressed
File /system/library/KerberosPlugins is not compressed
File /system/library/Keyboard Layouts is not compressed
File /system/library/Keychains is not compressed
File /system/library/LaunchAgents is not compressed
File /system/library/LaunchDaemons is not compressed
File /system/library/LoginPlugins is not compressed
File /system/library/Modem Scripts is not compressed
File /system/library/MonitorPanels is not compressed
File /system/library/OpenSSL is not compressed
File /system/library/Perl is not compressed
File /system/library/PodcastProducer is not compressed
File /system/library/PreferencePanes is not compressed
File /system/library/Printers is not compressed
File /system/library/PrivateFrameworks is not compressed
File /system/library/QuickLook is not compressed
File /system/library/QuickTime is not compressed
File /system/library/QuickTimeJava is not compressed
File /system/library/Sandbox is not compressed
File /system/library/Screen Savers is not compressed
File /system/library/ScreenReader is not compressed
File /system/library/ScriptingAdditions is not compressed
File /system/library/ScriptingDefinitions is not compressed
File /system/library/Security is not compressed
File /system/library/Services is not compressed
File /system/library/Sounds is not compressed
File /system/library/Speech is not compressed
File /system/library/Spelling is not compressed
File /system/library/Spotlight is not compressed
File /system/library/StartupItems is not compressed
File /system/library/SyncServices is not compressed
File /system/library/SystemConfiguration is not compressed
File /system/library/SystemProfiler is not compressed
File /system/library/Tcl is not compressed
File /system/library/TextEncodings is not compressed
File /system/library/User Template is not compressed
File /system/library/UserEventPlugins is not compressed
File /system/library/WidgetResources is not compressed
Artie-s-Computer-4:~ artie$ 
Posted By: artie505 Re: Anomalous "Restore" results? - 06/28/10 10:40 AM
Quote:
(Since your target was smaller than your source, a block-level copy wouldn't have been possible; also, you'd've needed to be booted from a third volume, since both source and target need to be unmountable for a block-level copy using ASR.) (Which leads to the following question: were you booted from a third volume? If so, was it a Leopard volume?)

1. I didn't know that about block-level copies (not to say that I've even fully digested the difference between file and block-level copies yet).

2.Yes, I booted into my Leopard volume to restore the SL volume.
Posted By: artie505 Re: Anomalous "Restore" results? - 06/28/10 10:43 AM
> The best way to avoid all these sorts of problems is always to click the "Erase Destination" check box when cloning. When using the Restore tab, this will often result in a block copy, which is pretty much guaranteed to be exactly the same as the original.

Does that hold true even if the destination volume has been erased beforehand?
Posted By: Hal Itosis Re: Anomalous "Restore" results? - 06/28/10 02:58 PM
Originally Posted By: artie505
/Volumes/HD2/3rd\ Party\ Stuff/Apps/Pacifist/hfs_comp_tool /system/library/*

hfs_comp_tool?   confused  Google comes up totally dry.

Care to share the wealth?


Originally Posted By: artie505
1. I didn't know that about block-level copies (not to say that I've even fully digested the difference between file and block-level copies yet).

Easy enough. File-level copies individual files one-by-one... so they will not end up in the same "physical" locations on the target disk. Logically identical pathnames, yes... but not in terms of "byte addresses" on disk. That's why/how a (normal) restore can "defragment" a disk.

Block-copy literally duplicates data by disk sectors (has no notion of "files" at all). Some call this the only true clone. [if the source disk has directory damage however, it will be faithfully reproduced on the target.]


Originally Posted By: artie505
2.Yes, I booted into my Leopard volume to restore the SL volume.

Apparently 10.5 and 10.6 will treat the new xattrs differently. (10.5 is unaware that they are "special" xattrs).


Originally Posted By: artie505
Does that hold true even if the destination volume has been erased beforehand?

Definitely. Disk Utility doesn't care if the disk is already erased or not. It *only* does a block-level copy when we tell it to do the erasing.
Posted By: artie505 Re: Anomalous "Restore" results? - 06/28/10 03:14 PM
> Care to share the wealth?

It's Charles's wealth to share, Hal. ("Artie, if I remember right, when you ran that tool I gave you earlier to check if files were compressed or not [....]" [#10757 - 06/27/10 02:44 AM Re: Anomalous "Restore" results? [Re: Hal Itosis]])
Posted By: CharlesS Re: Anomalous "Restore" results? - 06/28/10 05:23 PM
Originally Posted By: artie505
You're correct about /sbin and /usr, Charles, but what about /System?

Those are mostly folders, so they can't be compressed anyway. But I would expect all the binary files inside those folders to end up being not compressed, if the restore tool is not preserving the compression.

Originally Posted By: artie505
> The best way to avoid all these sorts of problems is always to click the "Erase Destination" check box when cloning. When using the Restore tab, this will often result in a block copy, which is pretty much guaranteed to be exactly the same as the original.

Does that hold true even if the destination volume has been erased beforehand?

Yes it does. There are a few cases where Restore will fall back to a file copy if it's impossible to do a block copy (such as if the original volume is larger than the destination), but most of the time, if you click "Erase Destination" in Disk Utility's Restore tab, you'll get a block copy. The status bar will tell you which kind of copy it's doing while it's performing the clone, so you'll know what's going on. Since none of the cloning tools out there currently seem to play nice with the HFS+ compression, a block copy in Disk Utility is probably the best way to do a clone for now, as long as the original volume is in good working order (it's also the fastest).

One thing that I do notice, though, is that you mention that you did the clone in Leopard. Since Leopard can't know about the UF_COMPRESSED flag, I'm surprised that the files didn't become damaged. In any case, it would be interesting to try a restore while booted from the Snow Leopard disc, since Snow Leopard's version of disktool is more likely to be aware of the new compression features (if it's not, this will be a good bug report to send to Apple).
Posted By: artie505 Re: Anomalous "Restore" results? - 06/29/10 09:15 AM
OK...
  • While booted into a different SL volume
  • I restored my main SL volume
  • From a 25Gb volume to a 200Gb volume
  • With the "Erase..." box checked.
The progress bar showed that a block-level copy was done.

find_sl_damaged_files returned no errors.

Here are the comparative results of running du:

Code:
Source:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
4.0M	/.fseventsd
4.0K	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
902M	/Applications
3.9M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.5G	/Library
1.0K	/net
  0B	/Network
744M	/private
2.6M	/sbin
1.7G	/System
174M	/Users
392M	/usr
4.0K	/Volumes
5.4G	/
Artie-s-Computer-4:~ artie$ 

and

Code:
Destination:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
4.0M	/.fseventsd
4.0K	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
902M	/Applications
3.9M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.5G	/Library
1.0K	/net
  0B	/Network
745M	/private
2.6M	/sbin
1.7G	/System
129M	/Users
392M	/usr
4.0K	/Volumes
5.4G	/
Artie-s-Computer-4:~ artie$ 
Posted By: dkmarsh Re: Anomalous "Restore" results? - 06/29/10 09:52 AM

Originally Posted By: artie505
OK...
  • While booted into SL
  • I restored my SL volume
  • From a 25Gb volume to a 200Gb volume
  • With the "Erase..." box checked (Since it's checked by default, my earlier "Restores" were done with it checked [but to a smaller volume].)

But were you booted from the volume you were restoring from? Because if that's the case, as I mentioned above, you won't get a block-level copy.

From man asr:

Originally Posted By: manpages for asr
restore restores a disk image or volume to another volume
(including a mounted disk image)

--source can be a disk image, /dev entry, or
volume mountpoint. In the latter two cases,
the volume must be unmountable or mounted read-only
in order for a erase blockcopy to occur (thus, one
cannot erase blockcopy the root filesystem as the
source, unless it happened to be mounted read-only).

Posted By: artie505 Re: Anomalous "Restore" results? - 06/29/10 09:57 AM
> But were you booted from the volume you were restoring from? Because if that's the case, as I mentioned above, you won't get a block-level copy.

Aaargh!!!

I forgot about that... More staring at progress bars.

See my edited original post for an update.

(I've done so many clones and "Restores" recently that I now watch progress bars, rather than count sheep, when I'm trying to fall asleep.)
Posted By: artie505 Re: Anomalous "Restore" results? - 06/29/10 10:04 PM
If this isn't a bug it's certainly a major OS X shortcoming. (The first time it happened I thought I had for sure misremembered what I had done, but it's reproducible.)

While booted into my SL volume I did a CCC file-level clone and a DU file-level "Restore" of the volume into which I was booted, with these results:

Code:
Source:
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
4.0M	/.fseventsd
4.0K	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
902M	/Applications
3.9M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.5G	/Library
1.0K	/net
  0B	/Network
746M	/private
2.6M	/sbin
1.7G	/System
155M	/Users
392M	/usr
4.0K	/Volumes
5.4G	/
Artie-s-Computer-4:~ artie$ 

Code:
Destination (CCC clone):
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
Password:
416K	/.fseventsd
 39M	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
902M	/Applications
3.9M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.5G	/Library
1.0K	/net
  0B	/Network
745M	/private
2.6M	/sbin
1.7G	/System
155M	/Users
392M	/usr
4.0K	/Volumes
5.4G	/
Artie-s-Computer-4:~ artie$ 
(Elapsed time: 00:11:54)

Code:
Destination (DU "Restore"):
Artie-s-Computer-4:~ artie$ sudo du -xhd1 /
4.4M	/.fseventsd
 36M	/.Spotlight-V100
  0B	/.Trashes
  0B	/.vol
1014M	/Applications
9.0M	/bin
  0B	/cores
4.5K	/dev
1.0K	/home
1.6G	/Library
1.0K	/net
  0B	/Network
220M	/private
6.8M	/sbin
3.4G	/System
155M	/Users
937M	/usr
4.0K	/Volumes
7.3G	/
Artie-s-Computer-4:~ artie$ 
(Restore took 15 minutes)

and, by way of example:

Code:
Destination (CCC clone):
Artie-s-Computer-4:~ artie$ /Volumes/HD2/3rd\ Party\ Stuff/Apps/Pacifist/hfs_comp_tool /bin/*
File /bin/[ is compressed
File /bin/bash is compressed
File /bin/cat is compressed
File /bin/chmod is compressed
File /bin/cp is compressed
File /bin/csh is compressed
File /bin/date is compressed
File /bin/dd is compressed
File /bin/df is compressed
File /bin/domainname is compressed
File /bin/echo is compressed
File /bin/ed is compressed
File /bin/expr is compressed
File /bin/hostname is compressed
File /bin/kill is compressed
File /bin/ksh is compressed
File /bin/launchctl is compressed
File /bin/link is compressed
File /bin/ln is compressed
File /bin/ls is compressed
File /bin/mkdir is compressed
File /bin/mv is compressed
File /bin/pax is compressed
File /bin/ps is compressed
File /bin/pwd is compressed
File /bin/rcp is compressed
File /bin/rm is compressed
File /bin/rmdir is compressed
File /bin/sh is compressed
File /bin/sleep is compressed
File /bin/stty is compressed
File /bin/sync is compressed
File /bin/tcsh is compressed
File /bin/test is compressed
File /bin/unlink is compressed
File /bin/wait4path is compressed
File /bin/zsh is compressed
Artie-s-Computer-4:~ artie$ 

Code:
Destination (DU "Restore"):
Artie-s-Computer-4:~ artie$ /Volumes/HD2/3rd\ Party\ Stuff/Apps/Pacifist/hfs_comp_tool /bin/*
File /bin/[ is not compressed
File /bin/bash is not compressed
File /bin/cat is not compressed
File /bin/chmod is not compressed
File /bin/cp is not compressed
File /bin/csh is not compressed
File /bin/date is not compressed
File /bin/dd is not compressed
File /bin/df is not compressed
File /bin/domainname is not compressed
File /bin/echo is not compressed
File /bin/ed is not compressed
File /bin/expr is not compressed
File /bin/hostname is not compressed
File /bin/kill is not compressed
File /bin/ksh is not compressed
File /bin/launchctl is not compressed
File /bin/link is not compressed
File /bin/ln is not compressed
File /bin/ls is not compressed
File /bin/mkdir is not compressed
File /bin/mv is not compressed
File /bin/pax is not compressed
File /bin/ps is not compressed
File /bin/pwd is not compressed
File /bin/rcp is not compressed
File /bin/rm is not compressed
File /bin/rmdir is not compressed
File /bin/sh is not compressed
File /bin/sleep is not compressed
File /bin/stty is not compressed
File /bin/sync is not compressed
File /bin/tcsh is not compressed
File /bin/test is not compressed
File /bin/unlink is not compressed
File /bin/wait4path is not compressed
File /bin/zsh is not compressed
Artie-s-Computer-4:~ artie$ 

CCC retains compression...DU does not.

Hmmm...
Posted By: artie505 Re: Anomalous "Restore" results? - 07/03/10 05:54 AM
I did one last (I hope!) experiment, a DU file-level "Restore" of my SL volume while booted into a different SL volume, and DU ran true to form, i.e. did not retain compression.
© FineTunedMac