Compute Resources on Edilitics | Optimizing Data Processing#

Edilitics relies on compute resources to execute data replication and transformation workflows, critical for maintaining efficient and scalable data operations. Each subscription plan allocates a specific amount of compute minutes, with options to purchase additional resources as needed. This guide provides a comprehensive overview of compute allocation, utilization, and management, enabling users to optimize their data processing effectively.

Compute Allocation by Plan#

Free Plan#

• Compute Allocation: Provides 30 minutes of compute per workspace per month, or 30 minutes per month for solo users.
• Reset Schedule: Compute minutes reset at the beginning of each month, ensuring users start with a fresh allocation.
• Additional Compute: No option to purchase additional compute under this plan.

Solo Plans#

• Compute Allocation: Offers 120 minutes of compute per month.
• Reset Schedule: Compute minutes reset monthly based on the subscription date.
• Additional Compute: Users have the option to purchase additional compute minutes as needed.

Enterprise Plans#

• Compute Allocation: Allocates 120 minutes of compute per user per month, aggregated at the workspace level (e.g., 10 users = 1200 minutes/month).
• Reset Schedule: Compute minutes reset monthly, with the cycle starting from the subscription date.
• Compute Usage: Managed at the workspace level, allowing for flexible resource distribution across users.
• Additional Compute: Additional compute minutes can be purchased to support high-demand workflows.

Additional Compute Pricing#

• 60 minutes: $2.99
• 300 minutes: $11.99
• 600 minutes: $23.99
• Over 600 minutes: $2.39 per 60 minutes

Compute Utilization#

Compute minutes are integral to executing both replication and transformation workflows within Edilitics. These workflows involve several critical steps:

Deployment Creation#

• Virtual Machine Provisioning: Edilitics provisions a dedicated virtual machine (VM) for each workflow, optimized with specific resources such as vCPUs and RAM.
• Secure Credential Handling: The platform securely transfers encrypted data source and destination credentials to the VM, ensuring secure processing.

Workflow Configuration#

• Replication Workflows: Edilitics configures the tables and the associated instructions for data replication.
• Transformation Workflows: The platform sets up operational configurations for each task within the transformation workflow, tailored to the specific needs of the data process.

Execution and Teardown#

• Data Processing: The VM processes the data according to the workflow type, executing complex replication or transformation tasks.
• VM Termination: Upon completion, the VM is securely terminated to ensure no residual data remains, maintaining system integrity.

Compute Usage Management#

Allocation and Purchased Compute#

• Allocated Compute: Compute minutes reset monthly and do not carry forward, ensuring a predictable resource cycle.
• Purchased Compute: Purchased compute minutes never expire and carry forward indefinitely, offering flexibility in managing compute resources over time.

Usage Hierarchy#

• Priority Utilization: Compute consumption first draws from the allocated quota. Once depleted, the platform automatically shifts to utilizing the purchased compute minutes, ensuring uninterrupted workflow execution.

Handling Compute Exhaustion#

Depletion of Compute Minutes#

• Automatic Continuation: If a workflow is in progress when compute minutes are depleted, Edilitics automatically allocates up to 15 additional minutes to ensure the workflow completes without interruption. This results in a maximum negative balance of -15 minutes.
• Subsequent Deduction: The additional compute utilized is deducted from the next month’s allocated compute. If available compute reaches zero or a negative balance, all active workflows are automatically paused, requiring manual resumption once new compute minutes are allocated or additional compute is purchased.

Real-Time Tracking#

• Monitoring Tools: Admins can monitor compute usage in real-time through the Usage Summary section under Org Settings in the Edilitics web app. This tool provides detailed insights into compute consumption, enabling users to optimize workflows and manage their compute budget effectively.

Efficient compute resource management is critical for continuous data processing on the Edilitics platform. By understanding and strategically managing compute allocation and usage, users can maximize the efficiency of their data replication and transformation workflows, ensuring consistent and scalable data operations.