Open AI ‘completions’ Endpoint…

Topic: Using Open AI "completions" endpoint with the gpt-3.5-turbo model.

Question: [from Paul] Question around performance — For generative content, has anyone learned any useful tips or tricks to improve performance time for responses? It seems the max_tokens property combined with the prompt length is primarily what determines the processing time. Thanks!

Next
Next

AI optimized ‘Search’ function within website