Copy files to servers [on hold]2019 Community Moderator ElectionDirectory sync with automatic peer discoveryMake disk/disk copy slowerIO throughput lower when only a single process using the disk?How to move space from 1 file system to another?Update block device with image while writing only the Delta, is it possible?C&C server strategiesCopy files in parallel from remote servers using some command on terminal?Resolving hostnames querying multiple DNS serversRunning script through ssh and evaluate some var/comand inside the host machineWhat is causing my rsyslog timezone offset and / or time to be incorrect?
How do I Interface a PS/2 Keyboard without Modern Techniques?
How does electrical safety system work on ISS?
Confused about Cramer-Rao lower bound and CLT
Is there a RAID 0 Equivalent for RAM?
Do we have to expect a queue for the shuttle from Watford Junction to Harry Potter Studio?
Why is so much work done on numerical verification of the Riemann Hypothesis?
Why can't the Brexit deadlock in the UK parliament be solved with a plurality vote?
The IT department bottlenecks progress, how should I handle this?
Does Doodling or Improvising on the Piano Have Any Benefits?
How would you translate "more" for use as an interface button?
How can ping know if my host is down
How much theory knowledge is actually used while playing?
Review your own paper in Mathematics
Why should universal income be universal?
Mysterious "Two documentclass or documentstyle commands."
Why the "ls" command is showing the permissions of files in a FAT32 partition?
Can I cause damage to electrical appliances by unplugging them when they are turned on?
How can I, as DM, avoid the Conga Line of Death occurring when implementing some form of flanking rule?
Are Captain Marvel's powers affected by Thanos breaking the Tesseract and claiming the stone?
How to draw a matrix with arrows in limited space
Shouldn’t conservatives embrace universal basic income?
How can I safely use "Thalidomide" in my novel while respecting the trademark?
Giving feedback to someone without sounding prejudiced
The Digit Triangles
Copy files to servers [on hold]
2019 Community Moderator ElectionDirectory sync with automatic peer discoveryMake disk/disk copy slowerIO throughput lower when only a single process using the disk?How to move space from 1 file system to another?Update block device with image while writing only the Delta, is it possible?C&C server strategiesCopy files in parallel from remote servers using some command on terminal?Resolving hostnames querying multiple DNS serversRunning script through ssh and evaluate some var/comand inside the host machineWhat is causing my rsyslog timezone offset and / or time to be incorrect?
I want to copy a file of size 10GB to 100,000 servers. How would i go about it (It should be an automated process)? Also, how would i ensure if all the other servers have the copy of it? What will be the time taken to do the entire process? I can think of sending chunks of data, making one server as the central server and start sending the chunks to other servers and use checksum to ensure the copy of the files. Is there a faster way than this Or if i am wrong, can someone explain me in detail how this process would be?
linux
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
put on hold as too broad by Jeff Schaller, GAD3R, ilkkachu, mosvy, msp9011 Mar 18 at 8:43
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
add a comment |
I want to copy a file of size 10GB to 100,000 servers. How would i go about it (It should be an automated process)? Also, how would i ensure if all the other servers have the copy of it? What will be the time taken to do the entire process? I can think of sending chunks of data, making one server as the central server and start sending the chunks to other servers and use checksum to ensure the copy of the files. Is there a faster way than this Or if i am wrong, can someone explain me in detail how this process would be?
linux
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
put on hold as too broad by Jeff Schaller, GAD3R, ilkkachu, mosvy, msp9011 Mar 18 at 8:43
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
4
Look into bittorrent; as more hosts gets the file all the remainder will update more quickly.
– DopeGhoti
Mar 12 at 19:41
add a comment |
I want to copy a file of size 10GB to 100,000 servers. How would i go about it (It should be an automated process)? Also, how would i ensure if all the other servers have the copy of it? What will be the time taken to do the entire process? I can think of sending chunks of data, making one server as the central server and start sending the chunks to other servers and use checksum to ensure the copy of the files. Is there a faster way than this Or if i am wrong, can someone explain me in detail how this process would be?
linux
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
I want to copy a file of size 10GB to 100,000 servers. How would i go about it (It should be an automated process)? Also, how would i ensure if all the other servers have the copy of it? What will be the time taken to do the entire process? I can think of sending chunks of data, making one server as the central server and start sending the chunks to other servers and use checksum to ensure the copy of the files. Is there a faster way than this Or if i am wrong, can someone explain me in detail how this process would be?
linux
linux
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
edited Mar 12 at 19:43
Rui F Ribeiro
41.6k1483141
41.6k1483141
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
asked Mar 12 at 19:30
Krupal DesaiKrupal Desai
1
1
put on hold as too broad by Jeff Schaller, GAD3R, ilkkachu, mosvy, msp9011 Mar 18 at 8:43
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
put on hold as too broad by Jeff Schaller, GAD3R, ilkkachu, mosvy, msp9011 Mar 18 at 8:43
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
4
Look into bittorrent; as more hosts gets the file all the remainder will update more quickly.
– DopeGhoti
Mar 12 at 19:41
add a comment |
4
Look into bittorrent; as more hosts gets the file all the remainder will update more quickly.
– DopeGhoti
Mar 12 at 19:41
4
4
Look into bittorrent; as more hosts gets the file all the remainder will update more quickly.
– DopeGhoti
Mar 12 at 19:41
Look into bittorrent; as more hosts gets the file all the remainder will update more quickly.
– DopeGhoti
Mar 12 at 19:41
add a comment |
0
active
oldest
votes
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
-linux
4
Look into bittorrent; as more hosts gets the file all the remainder will update more quickly.
– DopeGhoti
Mar 12 at 19:41