Rstudio : openxlsx read loop crashes when no delay added … why? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) 2019 Community Moderator Election Results Why I closed the “Why is Kali so hard” questionWhy RStudio source pdf output difference with R prompt?When I try to configure RStudio for installation on Linux Mint I get a libcurl error
prime numbers and expressing non-prime numbers
How do I stop a creek from eroding my steep embankment?
Check which numbers satisfy the condition [A*B*C = A! + B! + C!]
Can a USB port passively 'listen only'?
What's the meaning of 間時肆拾貳 at a car parking sign
List of Python versions
Book where humans were engineered with genes from animal species to survive hostile planets
What does an IRS interview request entail when called in to verify expenses for a sole proprietor small business?
How widely used is the term Treppenwitz? Is it something that most Germans know?
Why do people hide their license plates in the EU?
Dating a Former Employee
How does debian/ubuntu knows a package has a updated version
Can I cast Passwall to drop an enemy into a 20-foot pit?
How to react to hostile behavior from a senior developer?
Why did the Falcon Heavy center core fall off the ASDS OCISLY barge?
porting install scripts : can rpm replace apt?
What LEGO pieces have "real-world" functionality?
Fundamental Solution of the Pell Equation
51k Euros annually for a family of 4 in Berlin: Is it enough?
Why is my conclusion inconsistent with the van't Hoff equation?
What is the meaning of the new sigil in Game of Thrones Season 8 intro?
2001: A Space Odyssey's use of the song "Daisy Bell" (Bicycle Built for Two); life imitates art or vice-versa?
English words in a non-english sci-fi novel
Why am I getting the error "non-boolean type specified in a context where a condition is expected" for this request?
Rstudio : openxlsx read loop crashes when no delay added … why?
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
2019 Community Moderator Election Results
Why I closed the “Why is Kali so hard” questionWhy RStudio source pdf output difference with R prompt?When I try to configure RStudio for installation on Linux Mint I get a libcurl error
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;
I have a loop where I load 10 huge excel 2007 files into a list of data.frame thanks to openxlsx library.
This loop crashes at the 4th file when no delay is added.
Adding a 500ms delay after each read solves the problem.
Can you tell me why?
Even if openxlsx doesn't use Java (unlike xlsx library) I guess that it's a problem of "garbage collection" that grows more quickly than it decrease... If I am right, does it exist a solution more "scientific" than a simple delay? (something like << .jcall("java/lang/System",,"gc") >> which is usefull for Java based xlsx read loop?)
Here is the code part that crashes (with the sys.sleep line that solves the pb) :
Library(openxlsx)
...
for (index in 1:10)
print(sprintf("Loading file : %s", List_files[index]))
Data[[List_years[index]]] <- readWorkbook(List_files[index], sheet=1, colNames=T, skipEmptyRows=T, detectDates=F)
Sys.sleep(0.5)
Thanks.
r
add a comment |
I have a loop where I load 10 huge excel 2007 files into a list of data.frame thanks to openxlsx library.
This loop crashes at the 4th file when no delay is added.
Adding a 500ms delay after each read solves the problem.
Can you tell me why?
Even if openxlsx doesn't use Java (unlike xlsx library) I guess that it's a problem of "garbage collection" that grows more quickly than it decrease... If I am right, does it exist a solution more "scientific" than a simple delay? (something like << .jcall("java/lang/System",,"gc") >> which is usefull for Java based xlsx read loop?)
Here is the code part that crashes (with the sys.sleep line that solves the pb) :
Library(openxlsx)
...
for (index in 1:10)
print(sprintf("Loading file : %s", List_files[index]))
Data[[List_years[index]]] <- readWorkbook(List_files[index], sheet=1, colNames=T, skipEmptyRows=T, detectDates=F)
Sys.sleep(0.5)
Thanks.
r
add a comment |
I have a loop where I load 10 huge excel 2007 files into a list of data.frame thanks to openxlsx library.
This loop crashes at the 4th file when no delay is added.
Adding a 500ms delay after each read solves the problem.
Can you tell me why?
Even if openxlsx doesn't use Java (unlike xlsx library) I guess that it's a problem of "garbage collection" that grows more quickly than it decrease... If I am right, does it exist a solution more "scientific" than a simple delay? (something like << .jcall("java/lang/System",,"gc") >> which is usefull for Java based xlsx read loop?)
Here is the code part that crashes (with the sys.sleep line that solves the pb) :
Library(openxlsx)
...
for (index in 1:10)
print(sprintf("Loading file : %s", List_files[index]))
Data[[List_years[index]]] <- readWorkbook(List_files[index], sheet=1, colNames=T, skipEmptyRows=T, detectDates=F)
Sys.sleep(0.5)
Thanks.
r
I have a loop where I load 10 huge excel 2007 files into a list of data.frame thanks to openxlsx library.
This loop crashes at the 4th file when no delay is added.
Adding a 500ms delay after each read solves the problem.
Can you tell me why?
Even if openxlsx doesn't use Java (unlike xlsx library) I guess that it's a problem of "garbage collection" that grows more quickly than it decrease... If I am right, does it exist a solution more "scientific" than a simple delay? (something like << .jcall("java/lang/System",,"gc") >> which is usefull for Java based xlsx read loop?)
Here is the code part that crashes (with the sys.sleep line that solves the pb) :
Library(openxlsx)
...
for (index in 1:10)
print(sprintf("Loading file : %s", List_files[index]))
Data[[List_years[index]]] <- readWorkbook(List_files[index], sheet=1, colNames=T, skipEmptyRows=T, detectDates=F)
Sys.sleep(0.5)
Thanks.
r
r
edited Jun 30 '15 at 14:20
Syl87
asked Jun 30 '15 at 14:15
Syl87Syl87
9017
9017
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
I found the solution for this issue yesterday .
I fact, I've tried the "gc()" command without success... but this was because it is necessary to force the cleaning with the reset option.
So "gc(reset=T)" works and is more efficient than the inserted delay.
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "106"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f213091%2frstudio-openxlsx-read-loop-crashes-when-no-delay-added-why%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
I found the solution for this issue yesterday .
I fact, I've tried the "gc()" command without success... but this was because it is necessary to force the cleaning with the reset option.
So "gc(reset=T)" works and is more efficient than the inserted delay.
add a comment |
I found the solution for this issue yesterday .
I fact, I've tried the "gc()" command without success... but this was because it is necessary to force the cleaning with the reset option.
So "gc(reset=T)" works and is more efficient than the inserted delay.
add a comment |
I found the solution for this issue yesterday .
I fact, I've tried the "gc()" command without success... but this was because it is necessary to force the cleaning with the reset option.
So "gc(reset=T)" works and is more efficient than the inserted delay.
I found the solution for this issue yesterday .
I fact, I've tried the "gc()" command without success... but this was because it is necessary to force the cleaning with the reset option.
So "gc(reset=T)" works and is more efficient than the inserted delay.
edited 10 hours ago
Rui F Ribeiro
42.1k1484142
42.1k1484142
answered Jul 8 '15 at 13:01
Syl87Syl87
9017
9017
add a comment |
add a comment |
Thanks for contributing an answer to Unix & Linux Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f213091%2frstudio-openxlsx-read-loop-crashes-when-no-delay-added-why%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
-r