Run & Schedule a Wrangle

Building a wrangle doesn’t change any data. To produce your output data store, you publish the wrangle, which saves the current version and runs it. After that, you can run it again whenever you like, or set it to run on a schedule.

When to use this

Publish when your wrangle is ready for the first time, and again whenever you change it. Add a schedule when the source data keeps changing, for example a survey still collecting responses, so the output stays up to date.

Permission Requirements

You need to be the wrangle’s Owner or have edit access to publish or schedule it.

---

Publish and run a wrangle

1. Open the wrangle - See Build a wrangle.
2. Click More → Publish Now - Data Wrangler checks every step first.
3. Fix any problems - If something’s wrong, you’ll see “DataWrangler Errors Found!” and “Please rectify all the errors before publish.” Click OK, then look for steps marked with a red !. Click each one and open its Validation Error tab to see what needs fixing.
4. Check it started - When the checks pass, you’ll see “Publish process started!”. The wrangle runs in the background, and creates or updates the output data store.

There’s no separate “Run” button. To run a wrangle again, even without changes, click Publish Now again. It’s hidden while a run is waiting or in progress.

---

Check whether it ran

In the editor

The status icon at the left of the editor’s toolbar shows the latest run. Hover over it to see:

Status	What it means
Pending	Waiting to run
Processing	Running now
Process Completed	Finished successfully
Process Failed	Something went wrong
Process Aborted	Stopped by the system, for example after several failed runs in a row
Process on Hold	Waiting for another run of this wrangle to finish

While a run is waiting or in progress, the status is checked again every minute. There’s no icon until the wrangle has run at least once.

On the Data Wrangler home

The Status column for wrangles shows Success, Pending, Processing, Failed (which includes aborted runs) or Draft (which includes runs on hold). See Getting started.

When a run fails

If a run fails, the wrangle’s subscribers get a notification: “Data Wrangler process … failed for …”. The owner is subscribed automatically. To get these too, subscribe to the wrangle from its More menu on the Data Wrangler home.

---

Run a wrangle on a schedule

1. Click More → Define Schedule - The Set Update Frequency dialog opens.
2. Choose how often - Daily, Weekly or Monthly, then fill in the options:
   • Daily: run once at a set time (Occurs), or repeatedly (Recurs) every so many hours or minutes between a Starts and Finishes time.
   • Weekly: tick the days, and choose a time (At).
   • Monthly: choose Update each month on day and a date, or Update on last day of month, and a time (At).
3. Set the start date - Choose a Schedule start date.
4. Untick Disable - A new schedule starts with Disable ticked. Untick it, or the schedule won’t run.
5. Click Save - You’ll see “Scheduling Data Wrangle saved.”

Schedule times are in Australian Eastern time

Times you set in Set Update Frequency are in Australian Eastern time (AUS Eastern Standard Time), whatever your own time zone. The dialog doesn’t say so, so convert your times before you save.

A few things to know:

• Scheduled runs use the last published version of the wrangle, not changes you haven’t published yet.
• Scheduled runs start only after a published version has run successfully once. After you publish again, they wait for that run to succeed.
• To pause a schedule, open Define Schedule, tick Disable and click Save. Your settings are kept.
• To see the current schedule, open Define Schedule again. There’s no next-run time shown anywhere.
• If you choose Recurs every so many minutes, use a number that divides evenly into 60, such as 15 or 30.

The Weighting step has its own recalculation schedule, separate from this one. See Weight data.

---

Frequently Asked Questions

Can I stop a wrangle while it’s running?

Not at the moment. Wait for the run to finish, or fail, before publishing again.

Can I see a history of past runs?

Not at the moment. The status icon shows only the latest run.

Why don’t I see Publish Now?

A run is waiting or in progress. Publish Now comes back when it finishes.

I changed my wrangle. Will the schedule pick up my changes?

Not until you publish. Scheduled runs always use the last published version.

My schedule isn’t running. Why?

Check that Disable is unticked and a Schedule start date is set. Also check that the wrangle has run successfully since it was last published.

What does Process on Hold mean?

Another run of the same wrangle was already in progress. The newer run waits, and only the latest waiting run goes ahead; earlier ones are marked Process Aborted.

---

Common Issues and Solutions

”DataWrangler Errors Found!”

At least one step isn’t set up properly.

1. Find the red ! - Each step with a problem is marked with a red !.
2. Read the errors - Click the step and open its Validation Error tab.
3. Fix and publish again - Common fixes: connect a missing line (“Missing connector to node : …”), choose a data source (“Please select dataStore”), or name the output (“Please specify DataStoreName.”).

”This DataWrangle is still publishing. Please wait after it finished and try again.”

A publish is already under way.

1. Wait - Give it a minute, then try again.

”Publish Success but failed to submit the process to queue.”

The wrangle was published, but its run didn’t start.

1. Publish again - Click More → Publish Now to start the run.
2. Contact support - If it keeps happening, contact support through Help in the header bar.

”Scheduling Data Wrangle failed.”

The schedule couldn’t be saved.

1. Check the start date - Make sure Schedule start date is set.
2. Check the interval - For Recurs in minutes, use a number that divides evenly into 60.
3. Try again - Then contact support if it still fails.

Process Failed

The run hit a problem. The failure notification includes the reason.

1. Read the notification - It says what went wrong, for example that the source data store no longer exists.
2. Fix the wrangle - Update the step involved.
3. Publish again - Click More → Publish Now.