Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?

What's a natural way to say that someone works somewhere (for a job)?

Your magic is very sketchy

What is the term when two people sing in harmony, but they aren't singing the same notes?

Generic lambda vs generic function give different behaviour

Irreducibility of a simple polynomial

There is only s̶i̶x̶t̶y one place he can be

How to combine multiple text files of different lengths and multiple columns by a column

Was the picture area of a CRT a parallelogram (instead of a true rectangle)?

Implement the Thanos sorting algorithm

Personal Teleportation as a Weapon

Ways to speed up user implemented RK4

Trouble understanding overseas colleagues

Increase performance creating Mandelbrot set in python

Teaching indefinite integrals that require special-casing

Where in the Bible does the greeting ("Dominus Vobiscum") used at Mass come from?

Mapping a list into a phase plot

What is difference between behavior and behaviour

I'm in charge of equipment buying but no one's ever happy with what I choose. How to fix this?

Why does John Bercow say “unlock” after reading out the results of a vote?

Greatest common substring

How do I keep an essay about "feeling flat" from feeling flat?

Why did Kant, Hegel, and Adorno leave some words and phrases in the Greek alphabet?

Can somebody explain Brexit in a few child-proof sentences?

Can I Retrieve Email Addresses from BCC?



Disk utilization on mdadm raid 5 is 100% even though none of the member disks is at 100%


Grow/resize RAID when upgrading visible size of disksHow to mount a disk from destroyed raid system?mdadm; previously working; after “failure”, cannot join array due to disk size“Spare” disk in a 2-disk mdadm RAID1 array?mdadm RAID 5 and parted unrecognized disk labelHow do I migrate a RAID system to a larger set of HDDS?mdadm raid filesystem differs from disk filesystemHow do I (re)build/create/assemble an IMSM RAID-0 array from disk images instead of disk drives using mdadm?mdadm 2x Raid 5 missing drivesUbuntu: RAID 10 degrades to RAID 0 after reboot?













1















I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question






















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago















1















I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question






















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago













1












1








1


1






I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)










share|improve this question














I am currently confused about the disk utilisation of one of my machines.



The setup:



I have a machine containing 4 2TB HDDs.
For those HDDs I used mdadm to configure a RAID 5 (called md2)
On MD2, I am using a luks-volume containing a btrfs filesystem.



Besides other use cases, I also have samba installed and use it to share files and create a TimeMachine Backup.



When copying over large files, I am able to use the complete 1G connection of the machine to read and write files. So regarding this, I am happy with the speed I get.



When it comes to timemachine backups (I assume, this causes non-sequential reads/writes) the transfer starts to be very slow.



The machine is not swapping and the CPU utilization is fine as well.



When looking at netdata, I see that the utilization for "root-crypted" is constantly on 100% (root-crypted is the name of the mounted file system).



I would then expect at least one of the HDDs to also be utilized at 100%, but actually none of them is. (They all are between 40 and 60%)
Now I am wondering, why the raid does not utilize the disks by 100%.



I assume, that I might be able to improve the performance by maybe 20% if I would just manage to have the raid utilizing the disks by 100%.



Is my thinking here correct or am I missing / misunderstanding something here.
Sadly my knowledge about disks and filesystems is not good enough to understand this.
Would be cool, if you could give me some support here.



Thanks a lot :)







hard-disk performance raid btrfs mdadm






share|improve this question













share|improve this question











share|improve this question




share|improve this question










asked yesterday









RacerRacer

315




315












  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago

















  • Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

    – wurtel
    10 hours ago
















Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

– wurtel
10 hours ago





Isn't the encryption layer the bottleneck? Note that btrfs in my experience is slow with lots of metadata updates.

– wurtel
10 hours ago










0






active

oldest

votes











Your Answer








StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);













draft saved

draft discarded


















StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes















draft saved

draft discarded
















































Thanks for contributing an answer to Unix & Linux Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid


  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f508494%2fdisk-utilization-on-mdadm-raid-5-is-100-even-though-none-of-the-member-disks-is%23new-answer', 'question_page');

);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-btrfs, hard-disk, mdadm, performance, raid

Popular posts from this blog

Mobil Contents History Mobil brands Former Mobil brands Lukoil transaction Mobil UK Mobil Australia Mobil New Zealand Mobil Greece Mobil in Japan Mobil in Canada Mobil Egypt See also References External links Navigation menuwww.mobil.com"Mobil Corporation"the original"Our Houston campus""Business & Finance: Socony-Vacuum Corp.""Popular Mechanics""Lubrite Technologies""Exxon Mobil campus 'clearly happening'""Toledo Blade - Google News Archive Search""The Lion and the Moose - How 2 Executives Pulled off the Biggest Merger Ever""ExxonMobil Press Release""Lubricants""Archived copy"the original"Mobil 1™ and Mobil Super™ motor oil and synthetic motor oil - Mobil™ Motor Oils""Mobil Delvac""Mobil Industrial website""The State of Competition in Gasoline Marketing: The Effects of Refiner Operations at Retail""Mobil Travel Guide to become Forbes Travel Guide""Hotel Rankings: Forbes Merges with Mobil"the original"Jamieson oil industry history""Mobil news""Caltex pumps for control""Watchdog blocks Caltex bid""Exxon Mobil sells service station network""Mobil Oil New Zealand Limited is New Zealand's oldest oil company, with predecessor companies having first established a presence in the country in 1896""ExxonMobil subsidiaries have a business history in New Zealand stretching back more than 120 years. We are involved in petroleum refining and distribution and the marketing of fuels, lubricants and chemical products""Archived copy"the original"Exxon Mobil to Sell Its Japanese Arm for $3.9 Billion""Gas station merger will end Esso and Mobil's long run in Japan""Esso moves to affiliate itself with PC Optimum, no longer Aeroplan, in loyalty point switch""Mobil brand of gas stations to launch in Canada after deal for 213 Loblaws-owned locations""Mobil Nears Completion of Rebranding 200 Loblaw Gas Stations""Learn about ExxonMobil's operations in Egypt""Petrol and Diesel Service Stations in Egypt - Mobil"Official websiteExxon Mobil corporate websiteMobil Industrial official websiteeeeeeeeDA04275022275790-40000 0001 0860 5061n82045453134887257134887257

Frič See also Navigation menuinternal link

Identify plant with long narrow paired leaves and reddish stems Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?What is this plant with long sharp leaves? Is it a weed?What is this 3ft high, stalky plant, with mid sized narrow leaves?What is this young shrub with opposite ovate, crenate leaves and reddish stems?What is this plant with large broad serrated leaves?Identify this upright branching weed with long leaves and reddish stemsPlease help me identify this bulbous plant with long, broad leaves and white flowersWhat is this small annual with narrow gray/green leaves and rust colored daisy-type flowers?What is this chilli plant?Does anyone know what type of chilli plant this is?Help identify this plant