Is there a way to limit the memory used by Gurobi algorithms ?
AnsweredHi,
I am working with big models for which the barrier method seems to be the most approriate solver according to my tuning tests. However, this algorithm uses tremendous memory ressources. Given that I send jobs to a scheduler for my optimizations, I need to specify the memory allocated, number of cpus etc. The problem is that Gurobi can unpredictable peaks in memory and it happens a lot that my jobs are killed because the memory I thought to be sufficient was not. My question therefore is the following: Can we control the maximal memory that guorbi can use to solve the model ? I already know about the parameter NodeFileStart but I can't really use it because it would slower too much the optimization.
Thank you in advance.
-
Official comment
-
Gurobi Staff
This post is more than three years old. Some information may not be up to date. For current information, please check the Gurobi Documentation or Knowledge Base. If you need more help, please create a new post in the community forum, or try Gurobot, our chatbot interface offering instant, expert-level support. -
-
-
Hi Sophie,
The parameter MemLimit limits the memory used by Gurobi. When the set memory limit is reached, an error is thrown. Thus, this parameter may not be suitable for your application. For very large models it is sometimes just not possible to compress all the model data, i.e., all coefficients, rows, columns, Barrier matrices etc., to a fixed memory amount. I think in your case, you should try to reduce the memory used as discussed in How do I avoid an out-of-memory condition? Usually, the best alternative is to switch to a bigger machine, e.g., a cloud machine, to execute the computations.
Best regards,
Jaromił0 -
-
Hi Jaromil,
Thank you very much. Very informative, exactly what I needed to know.
Regards,
Sophie
0 -
Post is closed for comments.
Comments
3 comments