Indeed, inter-node communication is needed. I support a few communication protocols:
Communicating through STDIN, STDOUT, STDERR with the container process. The link is automatically established between the initiating process and the target process. This form of communication is convenient for console applications when you want to pass some simple input to the command and see the result.
Uploading and downloading files to and from the container. This is convenient if you run a big batch job, like generating a bunch of images or a video using AI.
Communicating through an open port. This is what that HuggingFace demo is using. It spins up a server for image generation, and clients send requests and read responses. MPI can also be supported this way - you’ll need to open a port and start MPI processes in the containers you want to communicate. If using this method, it is up to the user to set up communication.
So far, I have yet to consider providing any additional communication mechanisms. The most convenient and efficient way depends on the use case. That’s why I’m seeking feedback. Would you be using such a system for some of your projects?
Indeed, inter-node communication is needed. I support a few communication protocols:
So far, I have yet to consider providing any additional communication mechanisms. The most convenient and efficient way depends on the use case. That’s why I’m seeking feedback. Would you be using such a system for some of your projects?