Connectors and Process Servers

Many Connectors require a Process Server with a particular service associated with it. For example, to use the Azure Machine Learning Connector, you need a Process Server with the ServiceForRedwood_AzureML service.

When you create a Connection for a particular Connector, RunMyJobs will prompt you to create a Queue and Process Server for that Connector, and will automatically assign the appropriate service to the Process Server. For example, if you install the Azure Synapse Connector, RunMyJobs will create an Azure Process Server with the required ServiceForRedwood_AzureSynapse service.

However, some Connectors share a single Connection Type. For example, Azure Synapse and Azure Machine Learning both use the Azure Connection type. If you install the Azure Synapse Connector first, and then install the Azure Machine Learning Connector, RunMyJobs will not prompt you to create a Process Server for Azure Machine Learning, because a Process Server for the Azure Connection Type already exists. If you then try to submit an Azure Machine Learning process, you may see an error similar to the following.

In this situation, there are two solutions:

• Stop the existing Process Server, then edit its definition and add the required service.

• Create a new Process Server for the new Connector and add the required service to it.

The option you choose depends on your needs. For example, if you have two Connectors with the same Connection Type, but you don't use them often, having both of them on a single Process Server might be fine. But if the Connectors have a high volume of traffic, you may want to have a separate Process Server for each Connector for efficiency reasons.