Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?

What's a natural way to say that someone works somewhere (for a job)?

Your magic is very sketchy

What is the term when two people sing in harmony, but they aren't singing the same notes?

Generic lambda vs generic function give different behaviour

Irreducibility of a simple polynomial

There is only s̶i̶x̶t̶y one place he can be

How to combine multiple text files of different lengths and multiple columns by a column

Was the picture area of a CRT a parallelogram (instead of a true rectangle)?

Implement the Thanos sorting algorithm

Personal Teleportation as a Weapon

Ways to speed up user implemented RK4

Trouble understanding overseas colleagues

Increase performance creating Mandelbrot set in python

Teaching indefinite integrals that require special-casing

Where in the Bible does the greeting ("Dominus Vobiscum") used at Mass come from?

Mapping a list into a phase plot

What is difference between behavior and behaviour

I'm in charge of equipment buying but no one's ever happy with what I choose. How to fix this?

Why does John Bercow say “unlock” after reading out the results of a vote?

Greatest common substring

How do I keep an essay about "feeling flat" from feeling flat?

Why did Kant, Hegel, and Adorno leave some words and phrases in the Greek alphabet?

Can somebody explain Brexit in a few child-proof sentences?

Can I Retrieve Email Addresses from BCC?



Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%


Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?













1















I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question






















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago















1















I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question






















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago













1












1








1


1






I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question














I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)







hard-disk performance raid btrfs mdadm






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked yesterday









RacerRacer

315




315












  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago

















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago
















Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

– wurtel
10 hours ago





Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

– wurtel
10 hours ago










0






active

oldest

votes











Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Unix & Linux Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-btrfs, hard-disk, mdadm, performance, raid

Popular posts from this blog

Word for a person who has no opinion about whether god existsWord for having a definite opinion while simultaneously withholding judgment?What's the opposite of “newcomer? Is ”veteran" OK?What do you call an “atheist” who might believe in an afterlife?What's a word for someone who wants to voice opinions but not have them challenged?Word for someone who dismisses contrary opinions as irrational?Somone who thinks they are overly special/out of the ordinaryIs there a word, phrase or idiom for “a person who is incapable of thinking about the future”?The belief that a god is human-likeA word for a non-famous person/thing you have heard a lot aboutAdjective for a person who enjoys taking care of their appearance

What was this official D&D 3.5e Lovecraft-flavored rulebook?What was this set of RPG tools called?As a first-time DM should I let my players play complex character classes and roles?Nymph's Kiss and the RelationshipWhat was the name of this Cleric Prestige Class that shapes metal with its bare hands?Are the 3.5e Dragonlance books third party or official works?What's up with the domain Vile Darkness?What was this 80s book about RPGs?What was the name of this Werewolf band?What book had Rituals to “upgrade” animal companions to keep them viable at higher levels?What was this RPG that had rules for player-owned businesses?

2017 IndyCar Series Contents Series news Teams and drivers Schedule Season summary Footnotes References External links Navigation menu"INDYCAR: Initial 2018 bodywork concepts unveiled"the original"IndyCar confirms switch to Performance Friction brakes in 2017""AJ Foyt Racing will switch to Chevy"the original"Carlos Munoz, Conor Daly will drive for AJ Foyt Racing""Zach Veach's Indy 500 Debut Confirmed with Foyt""No mass exodus from Honda after Ganassi switch""Ex-F1 driver Sato joins Andretti Autosport for 2017 IndyCar season""IndyCar's Ryan Hunter-Reay, sponsor DHL paired through 2020""hhgregg and Andretti Autosport announce partnership for key races in 2016""INDYCAR: Rossi re-signs with Andretti"the original"McLaren Formula 1 - Fernando Alonso to race at Indy 500 with McLaren, Honda and Andretti Autosport""Shank will finally take part in Indy 500 with Harvey, Andretti | MotorSportsTalk""Andretti adds Jack Harvey to Indy 500 field""Ganassi switches to Honda power for 2017""INDYCAR: Chilton returns to Ganassi"the original"IndyCar silly season: Who's going where in 2017?""INDYCAR: Kanaan, NTT Data return to Ganassi"the original"Kimball to remain at Ganassi for 2017""Coyne confirms Bourdais for 2017 IndyCar season""Davison to sub for Bourdais in Indy 500"the original"Gutierrez confirmed for Detroit IndyCar debut""Gutierrez returns with Coyne for rest of 2017 season""Vautier to drive for Coyne at Texas"the original"INDYCAR: Coyne confirms Jones for 2017"the original"Pippa Mann returns to Coyne for Indy 500""Karam, Dreyer & Reinbold teaming up again for Indianapolis 500""Pigot to return to Ed Carpenter Racing""Hildebrand confirmed as full-time Ed Carpenter driver""Veach to replace injured Hildebrand at Barber"the originalNew Team Harding Racing Enters Chaves for 101st Indianapolis 500"Juncos Racing Announces Entry in 101st Running of the Indianapolis 500 :: Juncos Racing""Juncos confirms Pigot for Indy 500""Saavedra confirmed in Juncos' second 500 entry"the original"Lazier confirms Indy 500 run after son's USF2000 debut"the original"Claman DeMelo to race for RLLR at Sonoma"the original"Rahal signs Servia and ace engineer for 2017""IndyCar: Aleshin returns with Schmidt"the original"Aleshin replaced by Saavedra for Toronto""Jack Harvey will pilot SPM No. 7 car at Watkins Glen, Sonoma""Jay Howard confirmed in Tony Stewart's supported SPM Indy entry""INDYCAR: Newgarden to wave the flag at Penske"the original"Pagenaud opts for No. 1 in 2017"the original"Penske confirms Newgarden for 2017""Montoya to stay with Team Penske in 2017""Target leaving IndyCar after 27 seasons with Chip Ganassi""Cavin: IndyCar could see complete driver/team shakeup in 2017""End of the road for KV Racing?""KV Racing confirms closure, equipment sold to Juncos""Juncos confirms IndyCar Series entry"the original"Juncos readies IndyCar program, aims for '17 500"the original"Harding Racing to add Texas, Pocono to schedule"the original"Sato signs with Andretti Autosport for 2017""INDYCAR: Aleshin in Doubt at SPM"the original"Long Beach notebook: JR Hildebrand breaks hand""Hildebrand cleared to return at Phoenix"the original"Bourdais to undergo surgery on multiple fractures""Aleshin loses Schmidt Peterson IndyCar ride""Saavedra in at SPM for Pocono, Gateway"the original"Bourdais to make return at Gateway"the original"The IndyCar Grand Prix no longer is sponsored by Angie's List""2017 IndyCar Series rulebook""2017 Verizon IndyCar Series Official Rulebook"Official websiteeeeee