What's the max batch size and how do you retrieve results? — expected answer: results come back via a results_url on the batch object; you poll processing_status until it's done

Question

Accepted Answer

You can submit up to 10,000 requests in a single batch. After submitting, the batch processes asynchronously. To retrieve results, you must poll the batch endpoint to check its `processing_status`. Once the status is `ended`, the batch object will contain an `results_url` field. You then download the results file from this URL, which contains the outputs for each request in the order of your original `custom_id` values. import Anthropic from '@anthropic-ai/sdk';
const client = new Anthropic();

async function waitForBatch(batchId) {
  while (true) {
    const batch = await client.beta.messages.batches.retrieve(batchId);
    
    if (batch.processing_status === 'ended') {
      // Results are ready
      const resultsResponse = await fetch(batch.results_url);
      const results = await resultsResponse.text(); // JSONL format
      return results;
    }
    
    if (batch.processing_status === 'failed' || 
        batch.processing_status === 'canceled' ||
        batch.processing_status === 'expired') {
      throw new Error(`Batch ${batch.processing_status}`);
    }
    
    // Still processing, wait and retry
    await new Promise(resolve => setTimeout(resolve, 5000));
  }
}

const results = await waitForBatch('batch_abc123');
console.log(results); // JSONL string with one line per request result

What's the max batch size and how do you retrieve results? — expected answer: results come back via a results_url on the batch object; you poll processing_status until it's done

The maximum batch size is 10,000 requests. Results are retrieved by polling the batch's `processing_status` until `ended`, then downloading from the provided `results_url`.

Scenario Questions

Follow-up Questions

What's the max batch size and how do you retrieve results? — expected answer: results come back via a results_url on the batch object; you poll processing_status until it's done

The maximum batch size is 10,000 requests. Results are retrieved by polling the batch's processing_status until ended, then downloading from the provided results_url.

Scenario Questions

Follow-up Questions

The maximum batch size is 10,000 requests. Results are retrieved by polling the batch's `processing_status` until `ended`, then downloading from the provided `results_url`.