Process finished with exit code -1073741819 (0xC0000005)
Awaiting user inputHi, I'm new to Gurobi, and I'm dealing with a large problem with it. My OS is windows 11, and I'm using gurobipy in PyCharm. I found that after root relaxation, the process terminated with output "Process finished with exit code -1073741819 (0xC0000005)". I searched the error code, it seems to be "memory access violation' error". There is also a suggestion that I should increase the recursion limit, since a Python script with infinite (or very deep) recursion can also lead to the error code (according to this). So I tried again with a smaller set of variables and constraints (I thought that they may not need that deep recursion), but the same error happened again, though the process ran longer before the error happened than the previous situation.
I also ran other python programs with the same settings in PyCharm, but they had no problem. So it couldn't be the problem of my configurations or settings.
I have several questions:
1. According to the error log file (attached below), I think the problem happened in the branch-and-cut tree search. Could the error happen because the nodes in the branch-and-cut tree are really deep and need a lot of recursions?
2. If the error is not caused by recursion, what is the possible cause?
3. As you can see, it is a really large model and takes a long time to optimize. Should I use barrier method?
Thank you in advance! I'm really worried.
<gurobi.Model MIP instance Historical_Phonology: 5200752 constrs, 12022242 vars, Parameter changes: Username=(user-defined), NonConvex=2>
Gurobi Optimizer version 10.0.0 build v10.0.0rc2 (win64)
CPU model: 12th Gen Intel(R) Core(TM) i7-12700, instruction set [SSE2|AVX|AVX2]
Thread count: 12 physical cores, 20 logical processors, using up to 20 threads
Optimize a model with 5200752 rows, 12022242 columns and 10401504 nonzeros
Model fingerprint: 0x8419eefb
Model has 1453200 quadratic objective terms
Model has 205362 quadratic constraints
Model has 6542260 general constraints
Variable types: 11942462 continuous, 79780 integer (79780 binary)
Coefficient statistics:
Matrix range [1e-01, 2e+00]
QMatrix range [1e+00, 2e+00]
QLMatrix range [1e+00, 1e+00]
Objective range [1e+00, 3e+00]
QObjective range [2e+00, 3e+00]
Bounds range [1e+00, 1e+01]
RHS range [1e-01, 7e+00]
QRHS range [1e+00, 1e+00]
GenCon coe range [1e+00, 1e+00]
GenCon const rng [1e+00, 1e+00]
Presolve removed 1504042 rows and 1553520 columns (presolve time = 6s) ...
Presolve removed 3003438 rows and 3052754 columns (presolve time = 10s) ...
Presolve removed 4105439 rows and 4155136 columns (presolve time = 16s) ...
Presolve removed 7856924 rows and 7906653 columns (presolve time = 21s) ...
Presolve removed 7858232 rows and 7906653 columns (presolve time = 25s) ...
Presolve removed 7863528 rows and 7912518 columns (presolve time = 30s) ...
Presolve removed 7864835 rows and 7914174 columns (presolve time = 35s) ...
Presolve removed 7864835 rows and 7914174 columns (presolve time = 40s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 45s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 51s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 59s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 63s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 67s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 74s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 77s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 83s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 86s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 91s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 96s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 102s) ...
Presolve removed 7869397 rows and 7919046 columns (presolve time = 105s) ...
Presolve removed 7869397 rows and 8012753 columns (presolve time = 110s) ...
Presolve removed 7869397 rows and 8213590 columns (presolve time = 115s) ...
Presolve removed 7869397 rows and 8410742 columns (presolve time = 120s) ...
Presolve removed 7869397 rows and 8596412 columns (presolve time = 125s) ...
Presolve removed 7869397 rows and 8785047 columns (presolve time = 130s) ...
Presolve removed 7869397 rows and 8954911 columns (presolve time = 135s) ...
Presolve removed 7869397 rows and 9120848 columns (presolve time = 140s) ...
Presolve removed 7869397 rows and 9302141 columns (presolve time = 145s) ...
Presolve removed 7869397 rows and 9483903 columns (presolve time = 150s) ...
Presolve removed 7869397 rows and 9663815 columns (presolve time = 155s) ...
Presolve removed 7869397 rows and 9885877 columns (presolve time = 160s) ...
Presolve removed 7869397 rows and 10160610 columns (presolve time = 165s) ...
Presolve removed 7869397 rows and 10418044 columns (presolve time = 170s) ...
Presolve removed 7869397 rows and 10629601 columns (presolve time = 175s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 180s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 186s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 190s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 195s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 200s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 205s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 210s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 215s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 220s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 225s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 230s) ...
Presolve removed 7869397 rows and 10720075 columns (presolve time = 239s) ...
Presolve removed 7869397 rows and 10751987 columns (presolve time = 245s) ...
Presolve removed 7869397 rows and 10751987 columns (presolve time = 246s) ...
Presolve removed 10671980 rows and 10753541 columns (presolve time = 250s) ...
Presolve removed 10671980 rows and 10753541 columns (presolve time = 255s) ...
Presolve removed 10735804 rows and 10753541 columns (presolve time = 262s) ...
Presolve removed 10735804 rows and 10758253 columns (presolve time = 267s) ...
Presolve removed 14970924 rows and 14993373 columns (presolve time = 270s) ...
Presolve removed 14970924 rows and 14993373 columns (presolve time = 275s) ...
Presolve removed 14973297 rows and 14993373 columns (presolve time = 280s) ...
Presolve removed 17696885 rows and 17719334 columns (presolve time = 285s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 291s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 295s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 300s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 305s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 311s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 315s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 320s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 326s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 330s) ...
Presolve removed 17701597 rows and 17719334 columns (presolve time = 336s) ...
Presolve removed 28326802 rows and 27444157 columns (presolve time = 1638s) ...
Presolve removed 28326802 rows and 27820979 columns (presolve time = 1641s) ...
Presolve removed 4461255 rows and 11333925 columns
Presolve time: 1640.53s
Presolved: 1079179 rows, 848650 columns, 2801865 nonzeros
Presolved model has 166964 bilinear constraint(s)
Variable types: 674758 continuous, 173892 integer (173892 binary)
Deterministic concurrent LP optimizer: primal simplex, dual simplex, and barrier
Showing barrier log only...
Root barrier log...
Ordering time: 2.60s
Barrier performed 0 iterations in 1647.18 seconds (719.57 work units)
Barrier solve interrupted - model solved by another algorithm
Concurrent spin time: 1.68s (can be avoided by choosing Method=3)
Solved with dual simplex
Use crossover to convert LP symmetric solution to basic solution...
Root crossover log...
44548 DPushes remaining with DInf 0.0000000e+00 1648s
0 DPushes remaining with DInf 0.0000000e+00 1648s
9172 PPushes remaining with PInf 0.0000000e+00 1649s
0 PPushes remaining with PInf 0.0000000e+00 1649s
Push phase complete: Pinf 0.0000000e+00, Dinf 1.9639498e-13 1649s
Root simplex log...
Iteration Objective Primal Inf. Dual Inf. Time
164145 8.5421490e+05 0.000000e+00 0.000000e+00 1649s
167193 8.5421490e+05 0.000000e+00 0.000000e+00 1649s
Extra simplex iterations after uncrush: 3048
Root relaxation: objective 8.542149e+05, 167193 iterations, 7.12 seconds (9.84 work units)
Total elapsed time = 1656.22s
Nodes | Current Node | Objective Bounds | Work
Expl Unexpl | Obj Depth IntInf | Incumbent BestBd Gap | It/Node Time
0 0 854214.905 0 35350 - 854214.905 - - 1668s
0 0 854214.905 0 32961 - 854214.905 - - 1698s
0 0 854274.488 0 32993 - 854274.488 - - 1709s
0 0 854281.592 0 32413 - 854281.592 - - 1733s
0 0 854302.064 0 29681 - 854302.064 - - 1738s
0 0 854348.280 0 29387 - 854348.280 - - 1756s
0 0 856024.182 0 26928 - 856024.182 - - 1763s
0 0 856048.989 0 26737 - 856048.989 - - 1781s
0 0 857426.525 0 22518 - 857426.525 - - 1789s
0 0 857437.580 0 21638 - 857437.580 - - 1798s
0 0 859313.037 0 23057 - 859313.037 - - 1810s
0 0 859493.656 0 21567 - 859493.656 - - 1826s
0 0 861295.393 0 22166 - 861295.393 - - 1832s
0 0 861442.264 0 22135 - 861442.264 - - 1848s
0 0 862416.889 0 19452 - 862416.889 - - 1854s
0 0 862417.389 0 19451 - 862417.389 - - 1855s
0 0 862670.461 0 20247 - 862670.461 - - 1868s
0 0 863293.206 0 14809 - 863293.206 - - 1874s
0 0 863293.206 0 14808 - 863293.206 - - 1874s
0 0 863333.631 0 14796 - 863333.631 - - 1885s
0 0 863677.822 0 13693 - 863677.822 - - 1892s
0 0 863678.156 0 13689 - 863678.156 - - 1892s
0 0 863888.219 0 14139 - 863888.219 - - 1904s
0 0 863998.312 0 13535 - 863998.312 - - 1909s
0 0 863998.520 0 13533 - 863998.520 - - 1909s
0 0 864209.669 0 13607 - 864209.669 - - 1921s
0 0 864210.669 0 13596 - 864210.669 - - 1922s
0 0 864268.911 0 12528 - 864268.911 - - 1927s
0 0 864269.042 0 12506 - 864269.042 - - 1928s
0 0 864453.942 0 12832 - 864453.942 - - 1939s
0 0 864454.648 0 12826 - 864454.648 - - 1940s
0 0 864512.660 0 12871 - 864512.660 - - 1945s
0 0 864686.325 0 13817 - 864686.325 - - 1958s
0 0 864686.653 0 13799 - 864686.653 - - 1959s
0 0 864771.166 0 12629 - 864771.166 - - 1965s
0 0 864772.693 0 12615 - 864772.693 - - 1966s
0 0 864895.112 0 13241 - 864895.112 - - 1980s
0 0 864896.739 0 13215 - 864896.739 - - 1981s
0 0 864896.739 0 13213 - 864896.739 - - 1982s
0 0 864973.659 0 12992 - 864973.659 - - 1987s
0 0 864975.649 0 13050 - 864975.649 - - 1988s
0 0 865112.461 0 13342 - 865112.461 - - 2003s
0 0 865114.617 0 13260 - 865114.617 - - 2004s
0 0 865161.650 0 13003 - 865161.650 - - 2011s
0 0 865161.850 0 13001 - 865161.850 - - 2012s
0 0 865282.919 0 13914 - 865282.919 - - 2028s
0 0 865284.252 0 13813 - 865284.252 - - 2029s
0 0 865345.666 0 13395 - 865345.666 - - 2037s
0 0 865345.999 0 13380 - 865345.999 - - 2037s
0 0 865463.271 0 13470 - 865463.271 - - 2055s
0 0 865467.011 0 13457 - 865467.011 - - 2056s
0 0 865496.175 0 12900 - 865496.175 - - 2064s
0 0 865572.710 0 13474 - 865572.710 - - 2082s
0 0 865574.950 0 13426 - 865574.950 - - 2083s
0 0 865598.618 0 13934 - 865598.618 - - 2091s
0 0 865599.891 0 13929 - 865599.891 - - 2092s
0 0 865670.389 0 14830 - 865670.389 - - 2111s
0 0 865672.762 0 14823 - 865672.762 - - 2112s
0 0 865690.696 0 12989 - 865690.696 - - 2120s
0 0 865690.696 0 12985 - 865690.696 - - 2121s
0 0 865745.597 0 13153 - 865745.597 - - 2140s
0 0 865747.904 0 13137 - 865747.904 - - 2142s
0 0 865748.086 0 13135 - 865748.086 - - 2142s
0 0 865764.396 0 12994 - 865764.396 - - 2150s
0 0 865764.796 0 12970 - 865764.796 - - 2151s
0 0 865804.861 0 14501 - 865804.861 - - 2171s
0 0 865805.377 0 14460 - 865805.377 - - 2171s
0 0 865844.902 0 15579 - 865844.902 - - 2187s
0 2 865844.902 0 15553 - 865844.902 - - 2488s
3 8 865845.375 2 15684 - 865845.375 - 2224 2492s
7 16 865845.400 3 15699 - 865845.400 - 1180 2497s
15 28 865845.467 4 15666 - 865845.467 - 647 2506s
27 40 865845.890 5 15700 - 865845.890 - 536 2514s
39 52 865845.958 6 15745 - 865845.958 - 515 2521s
51 64 865846.410 7 15600 - 865846.376 - 516 2529s
63 76 865846.435 8 15605 - 865846.376 - 522 2535s
75 88 865846.487 9 15598 - 865846.376 - 485 2542s
87 100 865846.673 10 15600 - 865846.376 - 439 2550s
99 112 865965.121 10 15513 - 865846.376 - 436 2556s
111 124 865846.678 11 15647 - 865846.376 - 405 2562s
123 136 865975.691 11 15516 - 865846.376 - 377 2568s
135 148 865846.851 12 15669 - 865846.376 - 358 2576s
147 160 865847.054 13 15563 - 865846.376 - 354 2583s
159 172 865975.884 13 15377 - 865846.376 - 347 2590s
171 184 865847.310 14 15566 - 865846.376 - 348 2597s
183 196 865955.303 14 15474 - 865846.376 - 371 2623s
195 208 865847.319 15 15467 - 865846.376 - 423 2639s
207 222 865848.201 16 15380 - 865846.376 - 464 2648s
221 234 865966.944 16 15281 - 865846.376 - 457 2667s
233 246 865848.212 17 15181 - 865846.376 - 489 2675s
245 258 865848.260 18 15183 - 865846.376 - 485 2682s
257 272 865956.190 18 15098 - 865846.376 - 490 2690s
271 296 865848.645 19 15208 - 865846.376 - 473 2703s
295 320 865848.659 20 15212 - 865846.376 - 451 2716s
319 344 865848.668 21 15115 - 865846.376 - 428 2729s
343 368 865848.914 23 15157 - 865846.376 - 410 2741s
367 392 865849.181 25 15103 - 865846.376 - 395 2767s
391 416 865849.244 27 14998 - 865846.376 - 403 2781s
415 440 865850.790 28 14947 - 865846.376 - 412 2796s
439 468 865857.739 29 14923 - 865846.376 - 419 2811s
467 492 865889.700 30 14980 - 865846.376 - 405 2825s
491 518 865985.089 31 14769 - 865846.376 - 394 2841s
517 546 865856.971 33 14720 - 865846.376 - 385 2857s
545 574 865856.994 34 14763 - 865846.376 - 386 2874s
573 604 865860.548 35 14737 - 865846.376 - 386 2893s
603 643 865864.220 36 14664 - 865846.376 - 385 2918s
642 683 865912.948 38 14557 - 865846.376 - 380 2945s
682 717 865861.466 41 14455 - 865846.376 - 400 2971s
716 770 865894.055 41 14217 - 865846.376 - 417 3024s
769 831 865886.234 43 14358 - 865846.376 - 460 3063s
830 889 865863.850 47 14423 - 865846.376 - 457 3102s
888 951 865864.106 50 14296 - 865846.376 - 459 3146s
950 1047 865882.706 53 14218 - 865846.376 - 448 3201s
1046 1157 865880.439 58 14155 - 865846.376 - 428 3257s
1156 1251 865911.103 63 13972 - 865846.376 - 400 3320s
1250 1356 865908.988 66 13804 - 865846.376 - 425 3410s
1355 1501 865889.605 73 13660 - 865846.376 - 469 3488s
1500 1652 865947.706 80 13125 - 865846.376 - 438 3635s
1651 1815 865891.059 86 12669 - 865846.376 - 510 3742s
1814 2019 865903.781 95 12227 - 865846.376 - 511 3849s
2018 2223 865915.917 104 12077 - 865846.376 - 482 3946s
2222 2427 865920.329 115 11828 - 865846.376 - 444 4048s
2426 2623 865926.287 125 11444 - 865846.376 - 413 4155s
2622 2827 865931.116 138 11300 - 865846.376 - 397 4251s
2826 3029 865948.399 147 11246 - 865846.376 - 379 4346s
3028 3233 865956.067 157 11302 - 865846.376 - 359 4433s
3232 3437 865963.628 168 11304 - 865846.376 - 338 4515s
3436 3641 865971.384 181 11261 - 865846.376 - 319 4599s
3555 3641 866333.816 144 10745 - 865846.376 - 308 4600s
3640 3845 865980.017 192 11188 - 865846.376 - 301 4675s
3844 4049 865986.916 205 11125 - 865846.376 - 286 4748s
4048 4252 865993.572 218 11045 - 865846.376 - 272 4832s
4251 4456 865998.113 228 10887 - 865846.376 - 261 4914s
4455 4660 866003.505 242 10514 - 865846.376 - 250 4994s
4659 4856 866009.546 251 10461 - 865846.376 - 240 5073s
4855 5053 866014.607 263 10372 - 865846.376 - 232 5159s
5052 5252 866017.339 272 10116 - 865846.376 - 225 5299s
5251 5454 866022.919 282 10041 - 865846.376 - 222 5380s
5453 5658 866024.651 291 10060 - 865846.376 - 215 5454s
5657 5835 866024.998 304 10100 - 865846.376 - 208 5783s
5834 6034 866028.680 315 9897 - 865846.376 - 380 5871s
6033 6223 866033.643 325 9845 - 865846.376 - 369 6175s
6222 6424 866037.470 336 9573 - 865846.376 - 441 6267s
6423 6627 866040.350 344 9565 - 865846.376 - 428 6349s
6626 6830 866046.180 354 9440 - 865846.376 - 415 6433s
6829 7034 866050.180 362 9432 - 865846.376 - 404 6529s
7033 7235 866055.406 372 9368 - 865846.376 - 393 6618s
7234 7439 866057.832 383 9124 - 865846.376 - 383 6702s
7438 7643 866060.819 395 9024 - 865846.376 - 374 6824s
7642 7842 866063.979 411 8927 - 865846.376 - 365 6941s
7841 8040 866063.255 422 8899 - 865846.376 - 357 7037s
8039 8233 866064.266 433 8792 - 865846.376 - 349 7371s
8232 8437 866065.103 445 8757 - 865846.376 - 404 7467s
8436 8640 866068.867 457 8619 - 865846.376 - 394 7569s
8639 8837 866072.291 468 8422 - 865846.376 - 386 8010s
8837 8838 866025.067 41 7651 - 865846.376 - 435 8028s
8839 8839 866396.998 269 9855 - 865846.376 - 435 8258s
8840 8840 866048.569 110 10956 - 865846.376 - 435 8332s
8841 8841 866276.309 246 10867 - 865846.376 - 435 8367s
8842 8841 866152.852 38 11746 - 865846.376 - 435 8473s
8843 8842 866210.045 134 12293 - 865846.376 - 435 8528s
8844 8843 866128.475 244 11549 - 865846.376 - 435 8625s
8845 8843 866226.138 183 11521 - 865846.376 - 435 8660s
8846 8844 866259.853 251 11582 - 865846.376 - 435 8722s
8847 8845 866199.695 75 11372 - 865846.376 - 435 8763s
8848 8845 866298.120 364 8584 - 865846.376 - 435 8852s
8849 8846 866272.559 283 7612 - 865846.376 - 434 8902s
8850 8847 866244.690 28 7256 - 865846.376 - 434 9003s
8851 8847 866419.412 325 7618 - 865846.376 - 434 9054s
8852 8848 866143.544 27 8344 - 865846.376 - 434 9172s
8853 8849 866261.227 444 8255 - 865846.376 - 434 9253s
8854 8849 866200.938 144 7274 - 865846.376 - 434 9380s
8855 8850 866295.221 351 7731 - 865876.492 - 434 9452s
8856 8851 866051.372 130 8393 - 865876.492 - 434 9530s
8857 8851 866049.077 17 8120 - 866049.077 - 434 9583s
8858 8852 866068.451 47 7794 - 866068.451 - 434 9673s
8859 8853 866261.227 444 8148 - 866072.845 - 434 9724s
8860 8853 866139.432 58 8700 - 866082.866 - 434 9811s
8861 8854 866201.734 458 9623 - 866108.891 - 434 9879s
8862 8855 866111.665 135 9676 - 866111.665 - 434 9983s
8863 8855 866133.604 245 10101 - 866129.623 - 434 10046s
8864 8856 866218.407 167 10015 - 866147.425 - 434 10157s
8865 8857 866299.096 358 10148 - 866168.797 - 434 10224s
8866 8857 866292.922 363 10335 - 866174.605 - 434 10335s
8867 8858 866295.422 368 10407 - 866193.331 - 434 10399s
8868 8859 866199.085 131 10464 - 866199.085 - 434 10573s
8869 8859 866289.721 340 10645 - 866217.777 - 434 10669s
8870 8860 866308.571 44 10757 - 866223.669 - 433 10826s
8871 8861 866261.735 256 10714 - 866223.917 - 433 10908s
8872 8861 866242.407 208 10695 - 866225.438 - 433 10973s
8873 8862 866227.681 125 10734 - 866227.681 - 433 11039s
8874 8863 866282.044 323 10810 - 866230.313 - 433 11113s
8875 8863 866230.876 61 10808 - 866230.876 - 433 11183s
8876 8864 866292.127 97 10933 - 866230.876 - 433 11270s
8877 8865 866231.420 255 11009 - 866231.420 - 433 11351s
8878 8865 866232.275 157 10977 - 866232.275 - 433 11434s
8879 8866 866232.275 194 11501 - 866232.275 - 433 11511s
8880 8867 866371.833 202 11724 - 866232.275 - 433 11579s
8881 8867 866232.275 104 12086 - 866232.275 - 433 11653s
8882 8868 866233.479 379 12428 - 866233.479 - 433 11729s
8883 8869 866234.174 181 12629 - 866234.174 - 433 11801s
8884 8869 866275.970 54 12633 - 866235.662 - 433 11869s
8885 8870 866238.267 75 12759 - 866238.267 - 433 11941s
8886 8871 866238.495 122 13277 - 866238.495 - 433 12034s
8887 8871 866421.934 342 14450 - 866239.069 - 433 12122s
8888 8872 866240.079 357 14702 - 866240.079 - 433 12203s
8889 8873 866291.221 343 14873 - 866241.636 - 433 12290s
8890 8873 866242.086 311 15046 - 866242.086 - 432 12370s
8891 8874 866242.682 13 15212 - 866242.682 - 432 12454s
8892 8875 866254.670 240 15234 - 866243.121 - 432 12536s
8893 8875 866294.641 350 15547 - 866243.748 - 432 12623s
8894 8876 866243.965 353 15604 - 866243.965 - 432 12701s
8895 8877 866244.971 135 15760 - 866244.971 - 432 12781s
8896 8877 866245.564 394 16355 - 866245.564 - 432 12940s
8897 8878 866245.592 177 17099 - 866245.592 - 432 13033s
8898 8879 866427.512 352 18044 - 866245.592 - 432 13125s
8899 8879 866245.609 78 18271 - 866245.609 - 432 13215s
8900 8880 866246.014 318 18274 - 866246.014 - 432 13301s
8901 8881 866246.815 99 18495 - 866246.815 - 432 13396s
8902 8881 866247.421 8 18474 - 866247.421 - 432 13484s
8903 8882 866248.016 310 18505 - 866248.016 - 432 13577s
8904 8883 866248.447 108 18489 - 866248.447 - 432 13672s
8905 8883 866248.899 315 18488 - 866248.899 - 432 13756s
8906 8884 866290.549 340 18491 - 866249.652 - 432 13849s
8907 8885 866250.202 24 18501 - 866250.202 - 432 13932s
8908 8885 866342.488 160 18489 - 866250.828 - 432 14030s
8911 8889 866250.828 344 7651 - 866250.828 - 748 14040s
8913 8890 866250.828 79 9961 - 866250.828 - 747 14271s
8914 8891 866250.828 215 10053 - 866250.828 - 747 14308s
8915 8892 866250.828 354 9373 - 866250.828 - 747 14333s
8916 8892 866250.828 300 9268 - 866250.828 - 747 14386s
8917 8893 866250.828 477 8921 - 866250.828 - 747 14418s
8918 8894 866250.828 180 8633 - 866250.828 - 747 14461s
8919 8894 866250.828 230 8727 - 866250.828 - 747 14486s
8920 8895 866250.828 19 8446 - 866250.828 - 747 14529s
8921 8896 866295.454 360 8490 - 866250.828 - 747 14560s
8922 8896 866284.716 330 8330 - 866250.828 - 747 14609s
8923 8897 866321.866 142 8390 - 866250.828 - 747 14633s
8924 8898 866250.828 107 8304 - 866250.828 - 747 14679s
8925 8898 866250.828 94 8372 - 866250.828 - 746 14703s
8926 8899 866250.828 47 8576 - 866250.828 - 746 14752s
8927 8900 866250.828 15 8572 - 866250.828 - 746 14780s
8928 8900 866250.828 83 8423 - 866250.828 - 746 14826s
8929 8901 866250.828 76 8475 - 866250.828 - 746 14853s
8930 8902 866250.828 6 8464 - 866250.828 - 746 14902s
8931 8902 866346.903 160 8508 - 866250.828 - 746 14926s
8932 8903 866275.021 299 8505 - 866250.828 - 746 14978s
8933 8904 866250.828 95 8541 - 866250.828 - 746 15002s
8934 8904 866250.828 311 8665 - 866250.828 - 746 15057s
8935 8905 866250.828 40 8673 - 866250.828 - 746 15087s
8936 8906 866286.052 335 8869 - 866250.828 - 746 15139s
8937 8906 866250.828 41 9068 - 866250.828 - 745 15169s
8938 8907 866250.828 228 7587 - 866250.828 - 745 15227s
8939 8908 866396.998 269 7011 - 866250.828 - 745 15257s
8940 8908 866250.828 110 6260 - 866250.828 - 745 15313s
8941 8909 866276.309 246 6249 - 866250.828 - 745 15342s
8942 8910 866250.828 38 5229 - 866250.828 - 745 15424s
8943 8910 866250.828 134 5402 - 866250.828 - 745 15465s
8944 8911 866250.828 244 5244 - 866250.828 - 745 15548s
8945 8912 866250.828 183 5330 - 866250.828 - 745 15595s
8946 8912 866259.853 251 5356 - 866250.828 - 745 15645s
8947 8913 866250.828 75 5469 - 866250.828 - 745 15673s
8948 8914 866298.120 364 5555 - 866250.828 - 745 15726s
8949 8914 866272.559 283 5816 - 866250.828 - 744 15758s
8950 8915 866250.828 28 5634 - 866250.828 - 744 15820s
8951 8916 866419.412 325 5838 - 866250.828 - 744 15851s
8952 8916 866250.828 27 6168 - 866250.828 - 744 15916s
8953 8917 866261.227 444 6425 - 866250.828 - 744 15951s
8954 8918 866250.828 144 6545 - 866250.828 - 744 16011s
8955 8918 866295.221 351 6688 - 866250.828 - 744 16048s
8956 8919 866250.828 130 6902 - 866250.828 - 744 16113s
8957 8920 866250.828 17 7286 - 866250.828 - 744 16154s
8958 8920 866250.828 47 7903 - 866250.828 - 744 16227s
8959 8921 866261.227 444 8185 - 866250.828 - 744 16274s
8960 8922 866250.828 58 8486 - 866250.828 - 744 16326s
8961 8922 866250.828 458 9140 - 866250.828 - 743 16377s
8962 8923 866250.828 135 9328 - 866250.828 - 743 16436s
8963 8924 866250.922 245 10106 - 866250.922 - 743 16486s
8964 8924 866252.287 167 9958 - 866252.287 - 743 16541s
8965 8925 866299.096 358 9890 - 866252.750 - 743 16590s
8966 8926 866292.922 363 10127 - 866252.774 - 743 16637s
8967 8926 866295.422 368 10456 - 866252.774 - 743 16696s
8968 8927 866252.774 131 10583 - 866252.774 - 743 16754s
8969 8928 866289.721 340 10704 - 866252.774 - 743 16803s
8970 8928 866308.571 44 11275 - 866253.019 - 743 16861s
8971 8929 866261.735 256 11918 - 866253.019 - 743 16925s
8972 8930 866253.344 208 11866 - 866253.344 - 743 16987s
8973 8930 866253.915 125 12005 - 866253.915 - 742 17044s
8974 8931 866282.044 323 12058 - 866254.789 - 742 17103s
8975 8932 866254.980 61 12020 - 866254.980 - 742 17169s
8976 8932 866292.127 97 12332 - 866255.437 - 742 17233s
8977 8933 866255.611 255 12523 - 866255.611 - 742 17294s
8978 8934 866256.291 157 12881 - 866256.291 - 742 17359s
8979 8934 866256.446 194 12472 - 866256.446 - 742 17433s
8980 8935 866371.833 202 12995 - 866257.278 - 742 17507s
8981 8936 866257.427 104 13220 - 866257.427 - 742 17593s
8982 8936 866257.811 379 13616 - 866257.811 - 742 17664s
8983 8937 866258.161 181 14086 - 866258.161 - 742 17738s
8984 8938 866275.970 54 14842 - 866259.196 - 742 17824s
8985 8938 866259.363 75 14985 - 866259.363 - 741 17900s
8986 8939 866259.725 122 15024 - 866259.725 - 741 17976s
8987 8940 866421.934 342 15061 - 866259.943 - 741 18052s
8988 8940 866260.368 357 15254 - 866260.368 - 741 18129s
8989 8941 866291.221 343 15336 - 866260.760 - 741 18213s
8990 8942 866261.329 311 15354 - 866261.329 - 741 18292s
8991 8942 866261.675 13 15409 - 866261.675 - 741 18372s
8992 8943 866262.216 240 15411 - 866262.216 - 741 18486s
8993 8944 866294.641 350 15366 - 866262.381 - 741 18568s
8994 8944 866263.146 353 15456 - 866263.146 - 741 18673s
8995 8945 866263.146 135 15456 - 866263.146 - 741 18743s
Process finished with exit code -1073741819 (0xC0000005)
-
Hi!
This is a pretty huge model with lots of nonlinearities (6 million general constraints, 1.4 million quadratic objective terms). It very much looks like you are running out of memory here. You should track/monitor the memory usage while you are running this model to verify that this is the case.
Generally, you could instruct Gurobi to write out parts of the search tree to reduce the memory requirements. This can be done with the NodefileStart parameter.
I am not too hopeful that you will find feasible or even optimal solutions to that model - it really appears to be extremely hard to solve, maybe too hard.
Cheers,
Matthias1 -
Yes, linear constraints and objectives are almost always easier to optimize than quadratic or general nonlinear ones.
Cheers,
Matthias1 -
That is very hard to say upfront. It also depends on your model and whether the reformulation still makes sense and provides a meaningful solution.
Cheers,
Matthias1 -
Hi!
Thanks for the fast response! Actually, my computer has a RAM of 128G, but it still seems not large enough. By the way, I wonder if linear objective terms are easier to optimize than quadratic objective terms?
0 -
Thanks! If I have to choose one from general term (like absolute value) and quadratic term, which one do you think may be easier to solve?
0 -
Hi! I need your help again, and thank you in advance!
This time I made the variable set smaller with fewer constraints, and I watched the usage of memory by the Task Manager on Windows. The task manager showed that the memory usage didn't exceed 15% (my computer has a RAM of 128G), but the error changed to "Process finished with exit code -1073740940 (0xC0000374)", which is still an error about memory. It really confused me.
Here is the log:
<gurobi.Model MIP instance Historical_Phonology: 418536 constrs, 1063326 vars, Parameter changes: Username=(user-defined), NonConvex=2>
Gurobi Optimizer version 10.0.0 build v10.0.0rc2 (win64)
CPU model: 12th Gen Intel(R) Core(TM) i7-12700, instruction set [SSE2|AVX|AVX2]
Thread count: 12 physical cores, 20 logical processors, using up to 20 threads
Optimize a model with 418536 rows, 1063326 columns and 863304 nonzeros
Model fingerprint: 0x934cc713
Model has 246264 quadratic objective terms
Model has 22350 quadratic constraints
Model has 613500 general constraints
Variable types: 1054386 continuous, 8940 integer (8940 binary)
Coefficient statistics:
Matrix range [1e-01, 2e+00]
QMatrix range [1e+00, 1e+00]
QLMatrix range [1e+00, 1e+00]
Objective range [1e+00, 3e+02]
QObjective range [2e+00, 1e+02]
Bounds range [1e+00, 1e+01]
RHS range [1e-01, 5e+00]
QRHS range [1e+00, 1e+00]
GenCon coe range [1e+00, 1e+00]
GenCon const rng [1e+00, 1e+00]
Presolve removed 591892 rows and 600574 columns (presolve time = 5s) ...
Presolve removed 591892 rows and 946477 columns (presolve time = 10s) ...
Presolve removed 591892 rows and 1018110 columns (presolve time = 15s) ...
Presolve removed 591892 rows and 1021686 columns (presolve time = 20s) ...
Presolve removed 2047147 rows and 2052281 columns (presolve time = 25s) ...
Presolve removed 2047175 rows and 2052281 columns (presolve time = 30s) ...
Presolve removed 2047371 rows and 2053221 columns (presolve time = 174s) ...
Presolve removed 2047371 rows and 2062209 columns (presolve time = 175s) ...
Presolve added 1034079 rows and 407247 columns
Presolve time: 175.33s
Presolved: 1941726 rows, 1694554 columns, 4850633 nonzeros
Presolved model has 1774 quadratic constraint(s)
Presolved model has 231192 bilinear constraint(s)
Variable types: 1280664 continuous, 413890 integer (413890 binary)
Deterministic concurrent LP optimizer: primal simplex, dual simplex, and barrier
Showing barrier log only...
Root barrier log...
Ordering time: 0.17s
Barrier statistics:
AA' NZ : 3.770e+06
Factor NZ : 9.599e+06 (roughly 500 MB of memory)
Factor Ops : 2.509e+08 (less than 1 second per iteration)
Threads : 10
Objective Residual
Iter Primal Dual Primal Dual Compl Time
0 -3.74857952e+07 -4.97731746e+09 6.62e+02 4.28e+01 1.69e+05 182s
1 -1.38677934e+07 -4.25996684e+09 3.13e+02 2.54e+02 8.04e+04 182s
2 -1.71510228e+06 -3.22042255e+09 6.27e+01 8.28e+01 1.77e+04 182s
3 2.92772699e+05 -2.32485773e+09 1.22e+01 1.60e+01 4.41e+03 182s
4 8.82544430e+05 -1.09130639e+09 2.34e+00 2.37e+00 1.20e+03 183s
5 1.01184254e+06 -2.46740036e+08 1.83e-01 2.64e-02 2.02e+02 183s
6 7.27449990e+05 -4.12411786e+07 1.88e-02 8.58e-12 3.24e+01 184s
7 4.40070794e+05 -1.75615102e+07 5.46e-03 3.50e-12 1.38e+01 184s
8 2.93843942e+05 -6.60097272e+06 1.88e-03 1.22e-12 5.30e+00 184s
9 1.34883502e+05 -2.38284758e+06 6.89e-04 3.94e-13 1.93e+00 184s
10 -2.50781861e+03 -1.35853293e+06 3.87e-04 2.01e-13 1.04e+00 184s
11 -9.54050418e+04 -9.62597937e+05 2.53e-04 1.26e-13 6.65e-01 185s
12 -1.55980029e+05 -7.64232777e+05 1.71e-04 8.88e-14 4.66e-01 185s
13 -2.13797830e+05 -6.03815452e+05 1.06e-04 5.86e-14 2.99e-01 185s
14 -2.60631954e+05 -5.01010998e+05 5.77e-05 1.14e-13 1.84e-01 185s
15 -2.96068058e+05 -4.44215915e+05 2.69e-05 1.31e-13 1.14e-01 185s
16 -3.13091454e+05 -4.09916258e+05 1.47e-05 6.75e-14 7.42e-02 186s
17 -3.22553412e+05 -3.81084826e+05 8.65e-06 9.95e-14 4.49e-02 186s
18 -3.29957666e+05 -3.58021616e+05 4.41e-06 1.14e-13 2.15e-02 186s
Barrier performed 18 iterations in 186.00 seconds (81.78 work units)
Barrier solve interrupted - model solved by another algorithm
Concurrent spin time: 0.67s (can be avoided by choosing Method=3)
Solved with dual simplex
Root simplex log...
Iteration Objective Primal Inf. Dual Inf. Time
184403 -3.3918319e+05 0.000000e+00 0.000000e+00 186s
Use crossover to convert LP symmetric solution to basic solution...
Root crossover log...
86168 DPushes remaining with DInf 0.0000000e+00 187s
0 DPushes remaining with DInf 0.0000000e+00 189s
Warning: Markowitz tolerance tightened to 0.5
38123 PPushes remaining with PInf 0.0000000e+00 189s
0 PPushes remaining with PInf 0.0000000e+00 190s
Push phase complete: Pinf 0.0000000e+00, Dinf 1.5187130e+04 190s
Root simplex log...
Iteration Objective Primal Inf. Dual Inf. Time
300779 -3.3918319e+05 0.000000e+00 1.518713e+04 190s
301972 -3.3918319e+05 0.000000e+00 9.550121e+03 190s
318674 -3.3918320e+05 0.000000e+00 2.877920e+02 195s
321061 -3.3918319e+05 0.000000e+00 0.000000e+00 196s
347871 -3.3918319e+05 0.000000e+00 0.000000e+00 200s
Extra simplex iterations after uncrush: 26810
Root relaxation: objective -3.391832e+05, 347871 iterations, 23.57 seconds (37.40 work units)
Total elapsed time = 219.85s
Total elapsed time = 224.65s
Nodes | Current Node | Objective Bounds | Work
Expl Unexpl | Obj Depth IntInf | Incumbent BestBd Gap | It/Node Time
0 0 -339183.19 0 98818 - -339183.19 - - 246s
0 0 -339183.18 0 98818 - -339183.18 - - 248s
Process finished with exit code -1073740940 (0xC0000374)0 -
That is interesting! Can you try updating your Gurobi version to 10.0.2? And can you also try running this on a different machine, if possible?
Thanks,
Matthias0
Please sign in to leave a comment.
Comments
7 comments