File Copy Speed Isuue

General support questions
Post Reply
kshurs
Posts: 2
Joined: 2019/04/23 11:12:39

File Copy Speed Isuue

Post by kshurs » 2019/04/23 11:36:03

HI,
I'm trying to copy 12TB of 32GB files.
Configuration "Storage A" is connected to 8G speed SAN and "Storage B" is connected to DAS at 8G speed.
The storage is all "ALL-FLASH" model and OS version is CentOS6.6
I checked three cases.


Case 1:
"Storage A" connected to SAN Single volume 15TB volume (gfs2)
- Local Server --> "Storage A" (gfs2)
- Speed of cp or rsync command : 400Mb/s

Case 2:
"Storage A" connected to SAN Single volume 15TB volume (ext4)
- Local Server --> "Storage A" (ext4)
- Speed of cp or rsync command : 200Mb/s

Case 3:
DAS connected "Storage B" Single size 15TB volume (ext4)
- Local Server --> "Storage A" (ext4)
- Speed of cp or rsync command : 200Mb/s

I do not understand. Even if there is a difference between ext4 and gfs2,
the speed differs by a factor of two. It is also slower than a SAN or DAS at 8G.

What should I identify?

For example, kernel tuning, file system reconfiguration, and so on ...


Thank you

User avatar
TrevorH
Site Admin
Posts: 33202
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: File Copy Speed Isuue

Post by TrevorH » 2019/04/23 14:05:34

The storage is all "ALL-FLASH" model and OS version is CentOS6.6
Why? Why doesn't anyone ever keep their systems up to date? CentOS 6.6 is going on for 5 years old. Run yum update to get to 6.10 ASAP. There are numerous - too many to count - high severity security vulnerabilities present in 6.6 that are fixed in 6.10.

I think you might want to re-read what you wrote. Your case 3 appears to have been cut and pasted from one of the others and I'm not sure you changed it all.

How are you testing this exactly? Exactly what set of commands are you using to get these numbers?
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

kshurs
Posts: 2
Joined: 2019/04/23 11:12:39

Re: File Copy Speed Isuue

Post by kshurs » 2019/04/23 14:14:43

There is a special reason to use 6.6. All of the tests were conducted directly.


The figures in the case are the storage monitoring tools and iops.

Thank you.

User avatar
TrevorH
Site Admin
Posts: 33202
Joined: 2009/09/24 10:40:56
Location: Brighton, UK

Re: File Copy Speed Isuue

Post by TrevorH » 2019/04/23 14:50:40

There is no "special reason" to use an insecure system. Unless it's in an isolated room with locks on the doors and no cables are attached, then it might be safe.

We need to know exactly how you are measuring this. I can already see that you don't know the difference between bits and bytes for example. Please show the exact commands that you run, in what order and the results of each of them directly with no interpretation.
The future appears to be RHEL or Debian. I think I'm going Debian.
Info for USB installs on http://wiki.centos.org/HowTos/InstallFromUSBkey
CentOS 5 and 6 are deadest, do not use them.
Use the FAQ Luke

Post Reply