Hello,
I’m experiencing timeouts when calling the OpenAI API for GPT-4 via C# Cloud Code. GPT-3.5 turbo works fine but the results aren’t as advanced. It appears there’s a script run-time limit as mentioned in the documentation.
Any insights on mitigating these timeouts?
Hi mChapuis,
What kind of duration do you think you would require there?
Know that we will be working on customizable limits for Cloud Code in a near future that will allow you to perform what you want to do there.
Hi Maxime!
I managed to tweak my prompt and I got ok results from GPT3.5 turbo. I’ll wait until Openai optimize GPT4 to use it. They seem to be really quick at updating their models so I don’t think it’s going to take years.
Thank you for your quick response!
Hello, good to know!
I was wondering what duration you would expect before timeout? 30 sec, a minute, more? based on your use cases.
I believe it should be 15 seconds or less for immediate results. If it’s taking too long, I can ask the user to come back later. Making something load for longer is not going to work I think…