Skip to main content

Jobs dashboard

Jobs in the sidebar To view the jobs dashboard, on the sidebar, click Jobs. The jobs dashboard provides a centralized view for managing and monitoring the execution of data processing tasks within your workflows. The jobs dashboard lists each job and its associated Status, Job ID, Created date and time, Workflow name, and Runtime duration. Each job’s status, shown in the Status column, can be: Pending job icon Pending: The job’s data is currently not attempting to be processed. In-progress job icon In Progress: The job’s data is attempting to be processed. Fully finished job icon Finished: 100% of the job’s data has been successfully processed. Partially finished job icon Finished: 90% to 99% of the job’s data has been successfully processed. Failed job icon Failed: Less than 90% of the job’s data has been successfully processed. Rejected job icon Rejected: The job failed the preflight check and processed no documents. Rejected jobs also appear when you filter the jobs dashboard by Failed or Finished.

Run a job

You must first have an existing workflow to run a job against.If you do not have an existing workflow, stop. Create a workflow, and then return here.To see your existing workflows, on the sidebar, click Workflows.
To run a job, on the sidebar, click Workflows, and then click Run in the row for the workflow that you want to run.

Monitor a job

Completed job The job details pane is a comprehensive section for monitoring the specific details of jobs executed within a particular workflow. To access this pane, click the specific job on the jobs dashboard. Clicking the Details button shows:
  • The job’s ID.
  • The job’s start date.
  • Information about what happened in each of the job’s stages.
Clicking the Errors button provides any available information about what might have gone wrong with the job or in any of its stages.

Preflight check

The Job Preflight Check runs before a job processes any documents. It checks that the credentials and settings are valid for each source connector, destination connector, and model-provider node (partitioner, chunker, embedder, enrichment, and extractor). It does not read or write documents. The check runs while the job is Pending (SCHEDULED in the API). Most checks finish in seconds, and some take a few minutes. You can cancel a pending job.

Which check results reject a job

If any node fails the check with one of these results, the job ends as Rejected (REJECTED in the API): Any other result lets the job run: AUTH_NETWORK_UNREACHABLE, AUTH_PROVIDER_UNAVAILABLE, PROVIDER_RATE_LIMITED, UNKNOWN, or a check that does not finish in time. If the problem is real, the job can still end as Failed (FAILED). A rejected job processed no documents. Rejected is a final status, and Unstructured does not retry the job.

Jobs that skip the preflight check

  • Test runs on local files that you upload in Unstructured Pipelines, such as on the Start page.
  • Jobs created from a workflow template.
  • Jobs for a workflow with the check turned off. Select Skip Preflight Check in the workflow settings, or set skip_preflight to true when you create or update a workflow. For a local-file processing job, set skip_preflight in the request_data of the create job request.
Without the check, a misconfigured connector fails partway through the run, and the job ends as Failed.
On dedicated instance and in-VPC deployments, availability of the Job Preflight Check depends on your deployment. Contact your Unstructured account team for details.

Investigate a rejected job

Jobs dashboard with a rejected job
1

Open the rejected job

On the sidebar, click Jobs, and then click the rejected job. The Details tab lists each rejected node with its category, such as Invalid credentials.Details tab for a rejected jobThe Errors tab shows the error message for each rejected node.Errors tab for a rejected job
2

Fix the connector or node

For a connector, click Open connector in its row on the Details tab, and then update and save its credentials or settings. For any other node, fix its settings in the workflow designer.
3

Run the workflow again

On the sidebar, click Workflows, and then click Run for the workflow. The run creates a new job.
For fixes by category, see Job rejected by the preflight check.