How to tune Linux machine in order to improve CPU load average and CPU utilization Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Community Moderator Election Results Why I closed the “Why is Kali so hard” questionUnstable network on integrated Debian environmentFile to access for CPU load average on AIXHigh Load Average, how to fix it?How is the “load average” interpreted in “top” output? Is it the same for all distributions?CPU and Load Average Conflict on EC2 serverUnusual high load average (due to peak I/O wait? irqs?)Is it possible to calculate CPU utilization from load average & top CPU% columnlinux top load average seems too highuptime + cpu load averageHigh CPU load average; how to find the root cause?
Should I use a zero-interest credit card for a large one-time purchase?
Short Story with Cinderella as a Voo-doo Witch
What exactly is a "Meth" in Altered Carbon?
ListPlot join points by nearest neighbor rather than order
Check which numbers satisfy the condition [A*B*C = A! + B! + C!]
Identify plant with long narrow paired leaves and reddish stems
Why do people hide their license plates in the EU?
How discoverable are IPv6 addresses and AAAA names by potential attackers?
Denied boarding although I have proper visa and documentation. To whom should I make a complaint?
How to tell that you are a giant?
How would the world control an invulnerable immortal mass murderer?
Resolving to minmaj7
porting install scripts : can rpm replace apt?
Is the Standard Deduction better than Itemized when both are the same amount?
What LEGO pieces have "real-world" functionality?
Using audio cues to encourage good posture
What is the role of the transistor and diode in a soft start circuit?
What is the meaning of the new sigil in Game of Thrones Season 8 intro?
What does this icon in iOS Stardew Valley mean?
Why are there no cargo aircraft with "flying wing" design?
How come Sam didn't become Lord of Horn Hill?
Why is my conclusion inconsistent with the van't Hoff equation?
Is pollution the main cause of Notre Dame Cathedral's deterioration?
List of Python versions
How to tune Linux machine in order to improve CPU load average and CPU utilization
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Community Moderator Election Results
Why I closed the “Why is Kali so hard” questionUnstable network on integrated Debian environmentFile to access for CPU load average on AIXHigh Load Average, how to fix it?How is the “load average” interpreted in “top” output? Is it the same for all distributions?CPU and Load Average Conflict on EC2 serverUnusual high load average (due to peak I/O wait? irqs?)Is it possible to calculate CPU utilization from load average & top CPU% columnlinux top load average seems too highuptime + cpu load averageHigh CPU load average; how to find the root cause?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
We are working with a huge Hadoop cluster.
We have 736 datanode machines
and each node has 16 cores × 2 threads.
On some machines we saw CPU load average (98-128 for 5 min).
After deep investigation, we found:
- no HW problem
- no disk problem
- no network problem
- no infra problem
What we still have not checked is about how to tune the Linux kernel parameters.
What are the parameters or any kernel parameters that can help the machines in order to get good CPU working with most CPU LOW load average?
http://linuxrealtime.org/index.php/Improving_the_Real-Time_Properties
linux rhel kernel cpu load-average
edited 4 hours ago
G-Man
13.7k93870
asked 8 hours ago
yaelyael
2,81753180
add a comment |
We are working with a huge Hadoop cluster.
We have 736 datanode machines
and each node has 16 cores × 2 threads.
On some machines we saw CPU load average (98-128 for 5 min).
After deep investigation, we found:
- no HW problem
- no disk problem
- no network problem
- no infra problem
What we still have not checked is about how to tune the Linux kernel parameters.
What are the parameters or any kernel parameters that can help the machines in order to get good CPU working with most CPU LOW load average?
http://linuxrealtime.org/index.php/Improving_the_Real-Time_Properties
linux rhel kernel cpu load-average
edited 4 hours ago
G-Man
13.7k93870
asked 8 hours ago
yaelyael
2,81753180
add a comment |
We are working with a huge Hadoop cluster.
We have 736 datanode machines
and each node has 16 cores × 2 threads.
On some machines we saw CPU load average (98-128 for 5 min).
After deep investigation, we found:
- no HW problem
- no disk problem
- no network problem
- no infra problem
What we still have not checked is about how to tune the Linux kernel parameters.
What are the parameters or any kernel parameters that can help the machines in order to get good CPU working with most CPU LOW load average?
http://linuxrealtime.org/index.php/Improving_the_Real-Time_Properties
linux rhel kernel cpu load-average
edited 4 hours ago
G-Man
13.7k93870
asked 8 hours ago
yaelyael
2,81753180
We are working with a huge Hadoop cluster.
We have 736 datanode machines
and each node has 16 cores × 2 threads.
On some machines we saw CPU load average (98-128 for 5 min).
After deep investigation, we found:
- no HW problem
- no disk problem
- no network problem
- no infra problem
What we still have not checked is about how to tune the Linux kernel parameters.
What are the parameters or any kernel parameters that can help the machines in order to get good CPU working with most CPU LOW load average?
http://linuxrealtime.org/index.php/Improving_the_Real-Time_Properties
linux rhel kernel cpu load-average
linux rhel kernel cpu load-average
edited 4 hours ago
G-Man
13.7k93870
asked 8 hours ago
yaelyael
2,81753180
edited 4 hours ago
G-Man
13.7k93870
asked 8 hours ago
yaelyael
2,81753180
edited 4 hours ago
G-Man
13.7k93870
edited 4 hours ago
G-Man
13.7k93870
edited 4 hours ago
G-Man
13.7k93870
13.7k93870
asked 8 hours ago
yaelyael
2,81753180
asked 8 hours ago
yaelyael
2,81753180
asked 8 hours ago
yaelyael
2,81753180
2,81753180
add a comment |
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f512795%2fhow-to-tune-linux-machine-in-order-to-improve-cpu-load-average-and-cpu-utilizati%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f512795%2fhow-to-tune-linux-machine-in-order-to-improve-cpu-load-average-and-cpu-utilizati%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
-cpu, kernel, linux, load-average, rhel
