Gurobi solver not working in Azure Cloud Function
Ongoing
Im deploying a Toy Model to Azure Function Apps. I get the following errors in the log when making a request to the durable function.
I have checked that the license file is in the correct location and being accessed, and made sure that all modules are installed.
Has anyone encountered this issue?
2024-10-21T21:04:21Z [Information] Installed local modules: aiohttp 3.10.10
2024-10-21T21:04:21Z [Information] Installed local modules: attrs 24.2.0
2024-10-21T21:04:21Z [Information] Installed local modules: azure-functions 1.21.3
2024-10-21T21:04:21Z [Information] Installed local modules: azure-functions-durable 1.2.9
2024-10-21T21:04:21Z [Information] Installed local modules: certifi 2024.8.30
2024-10-21T21:04:21Z [Information] Installed local modules: charset-normalizer 3.4.0
2024-10-21T21:04:21Z [Information] Installed local modules: cloudpickle 3.0.0
2024-10-21T21:04:21Z [Information] Installed local modules: frozenlist 1.4.1
2024-10-21T21:04:21Z [Information] Installed local modules: furl 2.1.3
2024-10-21T21:04:21Z [Information] Installed local modules: gurobipy 11.0.0
2024-10-21T21:04:21Z [Information] Installed local modules: idna 3.10
2024-10-21T21:04:21Z [Information] Installed local modules: multidict 6.1.0
2024-10-21T21:04:21Z [Information] Installed local modules: numpy 2.1.2
2024-10-21T21:04:21Z [Information] Installed local modules: orderedmultidict 1.0.1
2024-10-21T21:04:21Z [Information] Installed local modules: ply 3.11
2024-10-21T21:04:21Z [Information] Installed local modules: propcache 0.2.0
2024-10-21T21:04:21Z [Information] Installed local modules: python-dateutil 2.9.0.post0
2024-10-21T21:04:21Z [Information] Installed local modules: requests 2.32.3
2024-10-21T21:04:21Z [Information] Installed local modules: six 1.16.0
2024-10-21T21:04:21Z [Information] Installed local modules: urllib3 2.2.3
2024-10-21T21:04:21Z [Information] Installed local modules: yarl 1.15.5
2024-10-21T21:04:21Z [Information] Installed local modules: azure-functions-worker 4.28.1
2024-10-21T21:04:21Z [Information] Installed local modules: azurefunctions-extensions-base 1.0.0a1
2024-10-21T21:04:21Z [Information] Installed local modules: grpcio 1.54.3
2024-10-21T21:04:21Z [Information] Installed local modules: aiosignal 1.3.1
2024-10-21T21:04:21Z [Information] Installed local modules: setuptools 69.5.1
2024-10-21T21:04:21Z [Information] Installed local modules: pip 24.0
2024-10-21T21:04:21Z [Information] Installed local modules: wheel 0.43.0
2024-10-21T21:04:21Z [Information] Installed local modules: aiohappyeyeballs 2.4.3
2024-10-21T21:04:21Z [Information] Installed local modules: protobuf 4.22.5
2024-10-21T21:04:21Z [Information] Installed local modules: Pyomo 6.8.0
2024-10-21T21:04:21Z [Information] c2fbee05d0cb4755b74ca64771ebd41b: Updated Instances table and set the runtime status to 'Running'
2024-10-21T21:04:21Z [Information] c2fbee05d0cb4755b74ca64771ebd41b: Deleting [ExecutionStarted] message from funchatchmodelapicasandbox-control-03
2024-10-21T21:04:21Z [Verbose] TaskOrchestrationDispatcher-3e147f4404da44babf6aae920098c38f-0: Finished processing work-item 'c2fbee05d0cb4755b74ca64771ebd41b'
2024-10-21T21:04:21Z [Error] Solver (gurobi) returned non-zero return code (1)
2024-10-21T21:04:21Z [Error] Solver log: Traceback (most recent call last): File "<stdin>", line 2, in <module> ModuleNotFoundError: No module named 'gurobipy'
2024-10-21T21:04:21Z [Error] Executed 'Functions.call_ToyModel' (Failed, Id=b9c6e6b7-fd47-445a-9d67-b627c787ebc5, Duration=139ms)
2024-10-21T21:04:21Z [Error] c2fbee05d0cb4755b74ca64771ebd41b: Function 'call_ToyModel (Activity)' failed with an error. Reason: System.Exception: ApplicationError: Solver (gurobi) did not exit normally ---> Microsoft.Azure.WebJobs.Script.Workers.Rpc.RpcException: Result: Failure Exception: ApplicationError: Solver (gurobi) did not exit normally Stack: File "/azure-functions-host/workers/python/3.11/LINUX/X64/azure_functions_worker/dispatcher.py", line 602, in _handle__invocation_request await self._run_async_func(fi_context, fi.func, args) File "/azure-functions-host/workers/python/3.11/LINUX/X64/azure_functions_worker/dispatcher.py", line 939, in _run_async_func return await ExtensionManager.get_async_invocation_wrapper( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/azure-functions-host/workers/python/3.11/LINUX/X64/azure_functions_worker/extension.py", line 147, in get_async_invocation_wrapper result = await function(**args) ^^^^^^^^^^^^^^^^^^^^^^ File "/home/site/wwwroot/function_app.py", line 134, in call_ToyModel solver.solve(model) File "/home/site/wwwroot/.python_packages/lib/site-packages/pyomo/opt/base/solvers.py", line 628, in solve raise ApplicationError("Solver (%s) did not exit normally" % self.name) at Microsoft.Azure.WebJobs.Script.Description.WorkerFunctionInvoker.InvokeCore(Object[] parameters, FunctionInvocationContext context) in /src/azure-functions-host/src/WebJobs.Script/Description/Workers/WorkerFunctionInvoker.cs:line 101 at Microsoft.Azure.WebJobs.Script.Description.FunctionInvokerBase.Invoke(Object[] parameters) in /src/azure-functions-host/src/WebJobs.Script/Description/FunctionInvokerBase.cs:line 82 at Microsoft.Azure.WebJobs.Script.Description.FunctionGenerator.Coerce[T](Task`1 src) in /src/azure-functions-host/src/WebJobs.Script/Description/FunctionGenerator.cs:line 225 at Microsoft.Azure.WebJobs.Host.Executors.FunctionInvoker`2.InvokeAsync(Object instance, Object[] arguments) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionInvoker.cs:line 53 at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.InvokeWithTimeoutAsync(IFunctionInvoker invoker, ParameterHelper parameterHelper, CancellationTokenSource timeoutTokenSource, CancellationTokenSource functionCancellationTokenSource, Boolean throwOnTimeout, TimeSpan timerInterval, IFunctionInstance instance) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionExecutor.cs:line 581 at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithWatchersAsync(IFunctionInstanceEx instance, ParameterHelper parameterHelper, ILogger logger, CancellationTokenSource functionCancellationTokenSource) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionExecutor.cs:line 527 at Microsoft.Azure.WebJobs.Host.Executors.FunctionExecutor.ExecuteWithLoggingAsync(IFunctionInstanceEx instance, FunctionStartedMessage message, FunctionInstanceLogEntry instanceLogEntry, ParameterHelper parameterHelper, ILogger logger, CancellationToken cancellationToken) in D:\a\_work\1\s\src\Microsoft.Azure.WebJobs.Host\Executors\FunctionExecutor.cs:line 306 --- End of inner exception stack trace ---. IsReplay: False. State: Failed. RuntimeStatus: Failed. HubName: funchatchmodelapicasandbox. AppName: func-hatch-modelapi-ca-sandbox. SlotName: Production. ExtensionVersion: 2.13.2. SequenceNumber: 7. TaskEventId: 0
0
-
I have no experience with Azure Function Apps. But the output shows
ModuleNotFoundError: No module named 'gurobipy'
Did you make sure that gurobipy is installed and can be found?
0 -
Additional to Marika's comment, can you see gurobipy as a subfolder of the following directory?
/home/site/wwwroot/.python_packages/lib/site-packages/
0 -
Hey,
Yes I made sure gurobipy is installed, I have outputted installed packages above and can see that gurobipy is listed. I have also navigated to that directory and I see the gurobipy subfolder.
0 -
A similar issue is reported in this Stack Overflow post.
https://stackoverflow.com/questions/72215655/local-module-not-found-in-azure-function
Can you see if the selected answer there helps?0 -
Hey,
The issue was being caused by the solver option "tee=True" being enabled as well as having a log file defined. It seems Azure is a read only environment and the log streams from the Gurobi server is causing an issue.
Disabling the logs resolved the issue but now cannot retrieve logs. Is there a Gurobi API to get logs by run ID directly from the server?
0
Please sign in to leave a comment.
Comments
5 comments