https://help.openai.com/en/articles/9197833-batch-api-faq
https://platform.openai.com/docs/api-reference/batch
Maybe there’s a use case for SCM users.
For me personally, I want to scrape 1000+ YouTube subtitles then summarize using custom prompt.
OpenAI Batch Job will push the cost down by 50% using gpt-4o mini (already cheap), you can even do BATCH prompt chaining/data enrichment.