Advanced No-Code Data Transformation with Edilitics | Enterprise Data Management#

Edilitics is a state-of-the-art data analytics platform that empowers enterprises to execute sophisticated data transformations with precision and adaptability. Our Transform module allows seamless modification and enhancement of datasets, supporting both no-code operations and custom-coded transformations. Whether your data resides within the same system or across different platforms, Edilitics provides the advanced tools needed to optimize your data for in-depth analysis and strategic decision-making.

Implementing Data Transformation in Edilitics#

Steps to Configure Data Transformation#

1. Access the Transform Module#

Navigate to the "Transformation" section within the Edilitics platform's sidebar.

2. Initiate a New Transformation Workflow#

Click the “New Transformation” button to begin configuring your data transformation workflow.

3. Select Source and Destination Integrations#

Identify your data source from the available integrations, then select the destination where the transformed data will be loaded.

Notes:

• Source and destination integrations can be distinct or identical. Only integrations compatible for use as destinations will be displayed.
• If the source and destination are distinct, all source data will be automatically mapped to data types supported by the destination.

4. Perform Data Operations#

• Base Table Selection: Start by selecting a base table for your transformation.
• Sample Data View: Edilitics provides a sample of 1,000 rows—comprising 500 from the head and 500 from the tail of your dataset—to offer a comprehensive view of your data before applying transformations.
• No-Code Operations: Utilize the extensive array of no-code transformation operations available in Edilitics. These operations are designed for ease of use, enabling you to modify and enhance your data without needing to write code.
• Custom Coding Options: For more advanced or complex transformations, take advantage of the integrated code editor. Here, you can input custom scripts tailored to your specific requirements. Edilitics will automatically verify, test, and execute your code as part of the transformation flow.
• Hybrid Workflows: You can seamlessly integrate both no-code operations and custom-coded steps within a single workflow. There is no limit to the number of operations that can be included, allowing for highly customized and iterative data transformations.

5. Define Transformation Title and Description#

Assign a unique and descriptive title to your transformation workflow to ensure clarity and traceability within your organization. Additionally, provide a concise description that encapsulates the objectives and nature of the transformed data.

6. Schedule Transformation Runs#

Configure the scheduling for your transformation workflow:

• Once: The transformation will run a single time, with manual triggering available if necessary.
• Daily: Automate the transformation to execute at a specified time each day.
• Custom Cron: Utilize custom cron expressions for granular control over the transformation schedule.

Example: A cron expression of "0 0 * * 1,4" will schedule the transformation to run at midnight on Mondays and Thursdays.

7. Save the Transformation Setup#

Finalize and save the configuration of your transformation workflow.

Monitoring and Managing Data Transformation#

Edilitics offers comprehensive tools to monitor and manage your data transformation workflows, ensuring complete visibility and control:

Detailed Run History#

Access a detailed log of all transformation activities, including success rates, failures, execution times, and user interactions (e.g., pause, resume, update, trigger), all captured with precise timestamps. Table-level details provide granular insights into data processing stages, aiding in efficient diagnostics and troubleshooting.

View Configuration#

Maintain a centralized overview of all tables involved in a transformation workflow, including their configurations and applied operations. This consolidated interface streamlines workflow management and enhances strategic decision-making.

On-Demand Triggering#

Address immediate data transformation needs by initiating a workflow run outside its scheduled time. Once complete, the workflow automatically resumes its predefined schedule, providing flexibility without disrupting ongoing processes.

Pause/Resume Control#

Exercise full governance over your data transformation workflows by pausing or resuming them as needed. This feature is particularly beneficial for conserving resources or preventing errors during scheduled maintenance of the source database.

Granular Sharing with Team Members#

Enhance collaboration by sharing transformation workflows with other workspace members. Shared users can monitor runs, view configurations, and trigger, pause, or resume workflows as necessary. Data security and ownership are maintained, as shared members cannot edit, delete, or further distribute the workflow.

Managing Transformation Workflows Throughout Their Lifecycle#

Edilitics empowers you to efficiently manage transformation workflows across their entire lifecycle:

Update Transformation Titles and Descriptions#

Maintain clarity and streamline workflow identification within your workspace by updating titles and descriptions directly from the Home Screen.

Modify Schedules#

Easily adjust the schedule of your transformation workflows from the Home Screen, enabling swift and efficient management of transformation timings.