What's New in Zoho DataPrep?

The all-new pipeline canvas lets you design the end-to-end data flow seamlessly. Earlier, there was a limitation of working with a single dataset at a time, but in 2.0, data can be fetched from multiple sources, more than one dataset can be prepared and used simultaneously as well as the data can be exported to multiple destinations. This helps business visualize data better, simplify complex workflows, and work on data with more confidence. Learn more 

In DataPrep 1.0, the sources and destinations had separate scheduling which had to be managed manually by staggering the schedule timing, which was hard. But with 2.0, the scheduling is now at the pipeline level. A single schedule can be used to manage imports, processing, and exports for all sources and destinations in the pipeline at once. 

In every pipeline run, choosing the incremental fetch option only fetches the new and updated data from the source and sends it to DataPrep for processing. Now, only the newly added rows are processed making each incremental fetch run faster. Thus making the job run more productive and cost effective. Learn more

Process data that was missed in previous schedules due to a change in data models or data preparation workflows. You can achieve this without having to perform all of the data processing one by one, especially in the case of file-based data pipelines. 

Data pipelines you build can now be saved as pipeline templates, making reusability and replication of data pipelines quite easy. 

We are also publishing various pipelines and rulesets in a gallery with pre-built templates that solves for various use cases around data preparation and cleansing. Users can use these pre-built templates to kick start their data preparation journey. Learn more

You can now save only selected rules as templates instead of saving the entire ruleset, and now you have the added flexibility of saving macros with specific functionality.

Ability to build automated data pipelines entirely depends on the platform's capability to connect to a variety of sources and destinations. With this in mind, we are adding a bunch of connectors to Zoho DataPrep. After we have added Zoho Creator connector, these are the connectors that are planned to be rolled out within the GA of DataPrep 2.0 version. 

• Salesforce connector for DataPrep 
• Zoho Bigin connector for DataPrep 
• Zoho Forms connector for DataPrep 

DataPrep now integrates with OpenAI's ChatGPT APIs to enable smarter data transformations and enrichment. We are now offering features like Transform by Example, Formula Generator, and Dataset Finder using this integration. 

When pushing data to your data destinations, there might be data model mismatches causing the export to fail partially, making it tough to resume the data exports and maintain data integrity. To avoid this, we provide schema validation automatically for all destinations that have data type support, such as databases and applications. 

We have drastically improved the observability of the Zoho DataPrep platform with new monitoring and audit capabilities. Let us look at what's improved in this front one by one. 

Every pipeline execution is now tracked as a job with the status of each stage tracked individually. the list of jobs is now listed for each pipeline and categorized by how it was triggered, whether it was a manual run, scheduled run, back fill run, etc. Learn more

Each job has three sections, the first section showing the status of each stage visually and the overview of the pipeline run with overall stats like rows processed, storage, time consumed, and the data interval of the particular job.

The second section shows a list view of all the processing stages, with individual status of each stage including details such as the rows processed and time consumed for processing the data. 

All jobs in Zoho DataPrep can now be monitored from our new home page, the Monitoring Dashboard. The new dashboard has information about successful and failed data pipelines in the system. Learn more

All changes done during data preparation in the data pipeline are tracked and saved as versions; you can always navigate to any version and revert the pipeline to that version at any time. In other words, this brings in unlimited undo/redo to your data pipeline throughout the entire life cycle. 

When working with pipelines, after you have reached a certain milestone and are ready to schedule the pipeline, you can mark the pipeline as ready. When marked as ready, that pipeline version is marked as the live version. When making additional changes, it will all be tracked as the draft versions and will not affect the scheduled jobs. When you're done with the changes, you can once again mark the pipeline as ready for the changes to take effect in the scheduled jobs. This way you can keep testing and experimenting with your data without affecting the production pipeline.

When an organization's data is made accessible to multiple stakeholders, it is crucial to be in the know as to who accesses which data. This feature helps you monitor which user has accessed which part of the data workflow within Zoho DataPrep; thus improving data security and accountability with access and activity audit logs.

With a tight Zoho Flow integration, connect Zoho DataPrep to numerous other software and solutions to automate your data workflow without having the need to code. It is a simple integration that lets you orchestrate data pipelines from Zoho Flow. You can now run data pipelines as an action within Zoho Flow and will have the option to trigger a flow using DataPrep triggers such as job success, job failure, job completion.
 

Enhance your data offerings effectively with your own completely rebranded version of Zoho DataPrep. Our DataPrep white labeling offering can help you provide professional data services for a fraction of a cost. Without IT experts or data analysts, easily mine data and prepare them with ease. 

To build integrations faster, we are publishing Rest API end points for Zoho DataPrep, which will soon be available to all users. You can now orchestrate data pipelines built within Zoho DataPrep via REST APIs integrated with any other applications or processes. This will provide you with options to start and stop data pipelines and allow you to get status information about jobs.

Zoho DataPrep is now integrated with Creator using the Zoho Creator connector. Zoho Creator is a powerful low-code application development platform that helps businesses build custom web and mobile apps faster.

Zoho DataPrep supports importing and exporting data to Microsoft SharePoint, a cloud storage service that allows users to store, organize, share, and access information from any device.

Zoho DataPrep is now HIPAA compliant which ensures the integrity of protected health information and having necessary safeguards in place to protect ePHI (electronic protected health information) that is collected, accessed, processed, and stored when at rest or in transit. Learn more

You can now export your prepared dataset in Zoho DataPrep as files to your FTP server. 
Learn more 

The Column Explorer feature allows you to search for, navigate to, and control visibility of the columns in your dataset. It helps you focus on the columns that matter in your dataset. 
Learn more 

OpenAI's ChatGPT integration with Zoho DataPrep enhances your data wrangling process multifold with advanced generative AI features powered by ChatGPT API. Here's how you can enable OpenAI integration for your DataPrep Org.

Note: The OpenAI integration is live only in US, EU, and IN Data Centers.

 

Transform by example easily helps you transform the data in any column just by providing examples of the output. Learn more 

Using the formula builder, you can enter your data requirements in natural language as prompts, and the formula will be generated automatically for you. Learn more 

Discover relevant public datasets and generate sample data by simply asking for it. Dataset finder enables you to generate datasets based on your data needs. Blend generated data with your dataset for data enrichment, data analysis, and more. Learn more 

Introducing export feature in Zoho CRM connector. You can now export clean, aggregated, and prepared data straight to your Zoho CRM account and build a robust sales data pipeline. Zoho DataPrep helps you continuously clean, prepare, migrate, and warehouse your CRM sales data. Learn more

The Google sheets connector now allows you to import your data from Google sheets into Zoho DataPrep directly.

Connect and import data from the shared folders of your Box and OneDrive with Zoho DataPrep.

With this feature, you can now select multiple columns at a single time and change their data types with a single click.

Zoho DataPrep helps you clean, prepare, migrate and warehouse your CRM sales data in more than one way. Enhance your Zoho CRM experience with Zoho DataPrep.

Connect your data in Zoho WorkDrive with Zoho DataPrep and schedule data imports and exports seamlessly.

The pivot transform distributes the data for easy consumption. It spreads out the data in long, winding tables by converting categories in rows to columns.

Zia, Zoho's AI assistant for business is now integrated with Zoho DataPrep to perform a global faceted system-wide search of your data.

Window functions enable you to perform summations and calculations based on a rolling window of data, relative to the current row. Unlike normal aggregate functions, the window functions keep the original rows intact and add the result as a new column.

Smart selection offers you an array of suggestions using the pattern matching notations when you select portions of the column data that you wish to transform.

Data cataloging helps with data management and discoverability depending on the usage of data assets, their status, and associated information.