What is pScheduler?

Introduction

pScheduler is responsible for managing the execution of network measurements, or more generally tasks, in perfSONAR. When you want to run a network measurement on perfSONAR you ask a pScheduler server, either through the pscheduler command-line client or through the pScheduler API.

Terminology

Archiver

Software that transfers results to long-term storage or elsewhere for further processing.

Assist Server

A pScheduler server that accepts a test specification and can return the lead participant. The assist server may or may not be involved in the test specified, it’s role is simply to tell you the lead where the task should be submitted. By default the assist server is always the local host.

Context

A construct that allows certain user-specified changes to the execution environment prior to the execution of a tool running a test.

Lead Participant

The pScheduler server where a task should be submitted. It will become responsible for contacting other participants, making scheduling decisions based on gathered information and archiving results.

Limits

Rules that define who is allowed to run what type of tests

Participant

A node that runs pScheduler and handles some facet of conducting a test.

Result

The observation produced by a tool conducting a test. For example, after conducting a throughput test, the iperf3 tool might generate a result that says “throughput from A to B was 3.4 Gb/s.”

Run

The act of conducting a task one time and producing a result.

Schedule Horizon

The amount ahead of time that pScheduler puts a run on the schedule.

Task

A job for pScheduler to do, consisting of a test to be carried out, scheduling information and other options.

Test

A set of the parameters required to perform a unit of work. A unit of work is usually a network measurement in perfSONAR, but could be any type of operation. Tests are generally named in terms of what is being produced, not what does the producing. As an example, if what is being produced is a report of the speed of a data transfer, then the test name is throughput NOT a tool name like iperf.

Tool

A program executed during a run of a task to carry out a test. For example, the iperf3 tool conducts throughput tests and the traceroute and tracepath tools conduct trace tests.

Benefits

The pScheduler server will handle the coordination, execution and optionally storage of the task requested. Many of the tools pScheduler executes could be run independently of pScheduler, but the added value provided by pScheduler is significant to perfSONAR hosts for the following reasons:

  • Measurement Integrity - pScheduler maintains a schedule of all measurements to be run and will not allow any measurements it knowns about to run simultaneously if doing so would adversely affect the result in a significant way. For example, it will not run two throughput tests at the same time as the competition for resources could affect the results of each. In contrast it will run latency tests in the background as the low resource consumption does not significantly affect results of parallel tests.

  • Simplified Coordination - pScheduler not only simplifies coordination during task execution, but also after you have the result. pScheduler will contact each end and handle bringing up any daemons as required. It also has a plug-in architecture that allows you to send the result elsewhere, such as a long-erm storage system, when the measurement completes.

  • Access Control - pScheduler has a limits system that allows the definition of rules about who can run what type of measurements.

  • Diagnostics - pScheduler gives you visibility into the schedule it maintains meaning you can determine when a task ran, runs or will run. It also keeps for some amount of time information about the outcome, including if the result was a failure, which can be useful for diagnosing issues with your test infrastructure.

In addition to these foundational features, perhaps pScheduler greatest asset is it’s extensibility. It allows allows plug-ins for new tests, tools and archivers to be written. This means that pScheduler is not limited by what it can do today, and it’s possible to extend it to perform new type of measurements or other functions as well as to have their results sent to new types of storage and/or analysis tools.

The remainder of this document provides some basic information on pScheduler and pointers to more detailed information where applicable.

Basic Command-Line Client Usage

Everything in the pScheduler command-line interface (CLI) begins by running the pscheduler program and specifying a command and, optionally, arguments:

pscheduler COMMAND [ ARGUMENTS ]

At all points along the command line, using the –help switch will cause pScheduler to display a synopsis of the command so far, available options and, where appropriate, examples.

For more information on specific commands and their arguments see:

Running A pScheduler Server

If you want tp be able to schedule tasks on your host you will need to run a pScheduler server. For more information on running a pScheduler server and to configure it with limits that meet your needs, see the following documents:

More Information

For useful reference material about different pSchedule options, plug-ins and more see the following: