Re: OT: fastest way to copy one drive to another

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 8 Sep 2018 at 10:01, Alexander Dalloz wrote:

Subject:        	Re: OT: fastest way to copy one drive to another
To:             	users@xxxxxxxxxxxxxxxxxxxxxxx
From:           	Alexander Dalloz <ad+lists@xxxxxxxxx>
Date sent:      	Sat, 8 Sep 2018 10:01:11 +0200
Send reply to:  	Community support for Fedora users 
<users@xxxxxxxxxxxxxxxxxxxxxxx>

> Am 08.09.2018 um 00:38 schrieb Michael D. Setzer II:
> > The jetcat-mod is a filter that monitors the process of the copy, and outputs
> > the info every 5 seconds with this option. The dialog then displays a running
> > graph of the progress along with estimated speed. In the clone case there is
> > no compression, so the rate is generally the physical speed of disk. With
> > image files that are compressed, the effective speed can vary greatly
> > depending on how much the data was compressed. Mostly just gives
> > progress versus just waiting for the dd command to finish.
> 
> Why no just dd parameter "status=progress"?
> 

Back in 2004, don't think status had progress as an option at all?
Second the format of the status is different, and reports on bytes and the 
output to screen comes at different rates, and is on the same line over and 
over.
Third, it doesn't have any relationship to the size of what is being copied in 
the data or time.

Did a test with an approximat 8G file

time dd bs=1M if=e-2009-02-22.lzo 2>/dev/null | /jetcat-mod -f 5000 -p 
8780465 | dd bs=1M of=testx.x 2>/dev/null
1.63% 	      140.00MB of 8574.67MB 	time: 0:00:03  46.67MB/sec
7.00% 	      600.00MB of 8574.67MB 	time: 0:00:08  75.00MB/sec
11.66% 	     1000.00MB of 8574.67MB 	time: 0:00:13  76.92MB/sec
16.93% 	     1452.00MB of 8574.67MB 	time: 0:00:18  80.67MB/sec
20.34% 	     1744.00MB of 8574.67MB 	time: 0:00:23  75.83MB/sec
23.65% 	     2028.00MB of 8574.67MB 	time: 0:00:28  72.43MB/sec
25.98% 	     2228.00MB of 8574.67MB 	time: 0:00:33  67.52MB/sec
29.16% 	     2500.00MB of 8574.67MB 	time: 0:00:38  65.79MB/sec
31.39% 	     2692.00MB of 8574.67MB 	time: 0:00:43  62.60MB/sec
33.96% 	     2912.00MB of 8574.67MB 	time: 0:00:48  60.67MB/sec
36.25% 	     3108.00MB of 8574.67MB 	time: 0:00:53  58.64MB/sec
39.51% 	     3388.00MB of 8574.67MB 	time: 0:00:58  58.41MB/sec
41.66% 	     3572.00MB of 8574.67MB 	time: 0:01:03  56.70MB/sec
45.02% 	     3860.00MB of 8574.67MB 	time: 0:01:08  56.76MB/sec
47.16% 	     4044.00MB of 8574.67MB 	time: 0:01:13  55.40MB/sec
49.96% 	     4284.00MB of 8574.67MB 	time: 0:01:18  54.92MB/sec
52.57% 	     4508.00MB of 8574.67MB 	time: 0:01:23  54.31MB/sec
55.23% 	     4736.00MB of 8574.67MB 	time: 0:01:28  53.82MB/sec
57.24% 	     4908.00MB of 8574.67MB 	time: 0:01:33  52.77MB/sec
59.62% 	     5112.00MB of 8574.67MB 	time: 0:01:38  52.16MB/sec
62.23% 	     5336.00MB of 8574.67MB 	time: 0:01:43  51.81MB/sec
64.94% 	     5568.00MB of 8574.67MB 	time: 0:01:48  51.56MB/sec
67.64% 	     5800.00MB of 8574.67MB 	time: 0:01:53  51.33MB/sec
70.72% 	     6064.00MB of 8574.67MB 	time: 0:01:58  51.39MB/sec
73.38% 	     6292.00MB of 8574.67MB 	time: 0:02:03  51.15MB/sec
76.18% 	     6532.00MB of 8574.67MB 	time: 0:02:08  51.03MB/sec
78.93% 	     6768.00MB of 8574.67MB 	time: 0:02:13  50.89MB/sec
81.26% 	     6968.00MB of 8574.67MB 	time: 0:02:18  50.49MB/sec
84.06% 	     7208.00MB of 8574.67MB 	time: 0:02:23  50.41MB/sec
86.81% 	     7444.00MB of 8574.67MB 	time: 0:02:28  50.30MB/sec
87.93% 	     7540.00MB of 8574.67MB 	time: 0:02:33  49.28MB/sec
90.31% 	     7744.00MB of 8574.67MB 	time: 0:02:38  49.01MB/sec
93.44% 	     8012.00MB of 8574.67MB 	time: 0:02:43  49.15MB/sec
95.16% 	     8160.00MB of 8574.67MB 	time: 0:02:48  48.57MB/sec
100.00%	     8373.71MB of 8574.67MB 	time: 0:02:52  48.68MB/sec
100

real	2m51.646s
user	0m0.817s
sys	1m18.394s

time dd bs=1M if=e-2009-02-22.lzo of=testx.x status=progress
8767143936 bytes (8.8 GB, 8.2 GiB) copied, 158 s, 55.5 MB/s
8373+1 records in
8373+1 records out
8780465661 bytes (8.8 GB, 8.2 GiB) copied, 158.455 s, 55.4 MB/s

real	2m38.507s
user	0m0.110s
sys	0m47.135s

The dd with progress was about 13 seconds faster, but doesn't show  
percentages or time info. 

The dialog progress bar uses the lines created every 5 seconds to show info 
and bar. 
Note: I just put the file size in the line, which wasn't in the correct format, size 
I just dropped the last 3 digits of byte  instead of converting it to K value.

Tried to post a message with an example of bar, but it is currently on hold 
since the 28K image file result in message being larger than 60K, which is 
the list limit. 

The info doesn't make a difference in the image, and is only to give progress 
info.


> Alexander
> _______________________________________________
> users mailing list -- users@xxxxxxxxxxxxxxxxxxxxxxx
> To unsubscribe send an email to users-leave@xxxxxxxxxxxxxxxxxxxxxxx
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives: https://lists.fedoraproject.org/archives/list/users@xxxxxxxxxxxxxxxxxxxxxxx


+------------------------------------------------------------+
 Michael D. Setzer II - Computer Science Instructor (Retired)     
 mailto:mikes@xxxxxxxx                            
 mailto:msetzerii@xxxxxxxxx
 Guam - Where America's Day Begins                        
 G4L Disk Imaging Project maintainer 
 http://sourceforge.net/projects/g4l/
+------------------------------------------------------------+

http://setiathome.berkeley.edu (Original)
Number of Seti Units Returned:  19,471
Processing time:  32 years, 290 days, 12 hours, 58 minutes
(Total Hours: 287,489)

BOINC@HOME CREDITS

ROSETTA      65778205.643098 | ABC          16613838.513356
SETI        109514958.178814 | EINSTEIN    141374481.499240
_______________________________________________
users mailing list -- users@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to users-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/users@xxxxxxxxxxxxxxxxxxxxxxx



[Index of Archives]     [Older Fedora Users]     [Fedora Announce]     [Fedora Package Announce]     [EPEL Announce]     [EPEL Devel]     [Fedora Magazine]     [Fedora Summer Coding]     [Fedora Laptop]     [Fedora Cloud]     [Fedora Advisory Board]     [Fedora Education]     [Fedora Security]     [Fedora Scitech]     [Fedora Robotics]     [Fedora Infrastructure]     [Fedora Websites]     [Anaconda Devel]     [Fedora Devel Java]     [Fedora Desktop]     [Fedora Fonts]     [Fedora Marketing]     [Fedora Management Tools]     [Fedora Mentors]     [Fedora Package Review]     [Fedora R Devel]     [Fedora PHP Devel]     [Kickstart]     [Fedora Music]     [Fedora Packaging]     [Fedora SELinux]     [Fedora Legal]     [Fedora Kernel]     [Fedora OCaml]     [Coolkey]     [Virtualization Tools]     [ET Management Tools]     [Yum Users]     [Yosemite News]     [Gnome Users]     [KDE Users]     [Fedora Art]     [Fedora Docs]     [Fedora Sparc]     [Libvirt Users]     [Fedora ARM]

  Powered by Linux