Batch Import

The Batch Import API allows you to upload large amounts of data in batches. A large data file is split into small batches, each batch not exceeding 100 MB, and imported using batch import. Alternatively, you can also use Zoho Analytics SDKs to simplify the batching process.

To import large amounts of data using Batch Import, follow the below steps:

  1. Split the large CSV file into batches (each batch not exceeding 100MB) and upload the first batch using the Batch Import API's {"batchKey":"start"} attribute.
  2. The server will generate a unique job ID and batch key for the import job and sends them to the user in response.
  3. Use the batch key you received, to submit the subsequent batches to the Batch Import API.
  4. Once all the batches are uploaded, confirm the end of the upload by adding {"isLastBatch":true} attribute to the last batch.

You can check the import job status using the 'Get Import Job Details' API with the jobId received in the Batch Import API response.

Notes:
  • Once the first batch import is complete, the scheduled import of subsequent batches gets initiated.
  • For 'Append' and 'UpdateAdd' import types, every batch is committed individually. So, the data from every batch will reflect immediately after uploading. 
  • For 'TruncateAdd' import type, data is committed only after uploading the last batch. So, the data will be reflected only after the batch import process is complete.
  • Batch order is maintained throughout the import process.
  • Upon job completion or in the case of errors, the import summary is stored.