Skip to main content
IMDIMD

Troubleshooting

Slow cleaning plan

Learn about plan complexity, data size, and optimization steps.

If a cleaning plan runs slowly, it may be because the plan is too complex or the data size is too large.

Optimizing the plan or batch processing can improve execution speed.

Plan complexity

Plans with many steps or complex operations run slower. Try simplifying the plan by removing unnecessary steps.

If a specific step is very complex, consider splitting it into multiple simpler steps.

Data size

Very large datasets cause any operation to slow down. Check the number of rows and fields in the data table.

If the data is too large, try filtering to a subset first.

Optimization steps

Some steps take longer than others. For example, filling a large number of missing values is slower than simple type conversion.

If a step is unnecessary, deleting it speeds up the overall execution.