Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?

What's a natural way to say that someone works somewhere (for a job)?

Your magic is very sketchy

What is the term when two people sing in harmony, but they aren't singing the same notes?

Generic lambda vs generic function give different behaviour

Irreducibility of a simple polynomial

There is only s̶i̶x̶t̶y one place he can be

How to combine multiple text files of different lengths and multiple columns by a column

Was the picture area of a CRT a parallelogram (instead of a true rectangle)?

Implement the Thanos sorting algorithm

Personal Teleportation as a Weapon

Ways to speed up user implemented RK4

Trouble understanding overseas colleagues

Increase performance creating Mandelbrot set in python

Teaching indefinite integrals that require special-casing

Where in the Bible does the greeting ("Dominus Vobiscum") used at Mass come from?

Mapping a list into a phase plot

What is difference between behavior and behaviour

I'm in charge of equipment buying but no one's ever happy with what I choose. How to fix this?

Why does John Bercow say “unlock” after reading out the results of a vote?

Greatest common substring

How do I keep an essay about "feeling flat" from feeling flat?

Why did Kant, Hegel, and Adorno leave some words and phrases in the Greek alphabet?

Can somebody explain Brexit in a few child-proof sentences?

Can I Retrieve Email Addresses from BCC?



Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%


Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?













1















I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question






















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago















1















I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question






















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago













1












1








1


1






I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question














I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)







hard-disk performance raid btrfs mdadm






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked yesterday









RacerRacer

315




315












  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago

















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago
















Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

– wurtel
10 hours ago





Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

– wurtel
10 hours ago










0






active

oldest

votes











Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Unix & Linux Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-btrfs, hard-disk, mdadm, performance, raid

Popular posts from this blog

Creating 100m^2 grid automatically using QGIS?Creating grid constrained within polygon in QGIS?Createing polygon layer from point data using QGIS?Creating vector grid using QGIS?Creating grid polygons from coordinates using R or PythonCreating grid from spatio temporal point data?Creating fields in attributes table using other layers using QGISCreate .shp vector grid in QGISQGIS Creating 4km point grid within polygonsCreate a vector grid over a raster layerVector Grid Creates just one grid

Nikolai Prilezhaev Bibliography References External links Navigation menuEarly Russian Organic Chemists and Their Legacy092774english translationRussian Biography

How to link a C library to an Assembly library on Mac with clangHow do you set, clear, and toggle a single bit?Find (and kill) process locking port 3000 on MacWho is listening on a given TCP port on Mac OS X?How to start PostgreSQL server on Mac OS X?Compile assembler in nasm on mac osHow do I install pip on macOS or OS X?AFNetworking 2.0 “_NSURLSessionTransferSizeUnknown” linking error on Mac OS X 10.8C++ code for testing the Collatz conjecture faster than hand-written assembly - why?How to link a NASM code and GCC in Mac OS X?How to run x86 .asm on macOS Sierra