Distributed Machine Learning with Ponos Agent

The Ponos agent is a lightweight Python script that is deployable on servers, and allow the Arkindex platform to run compute-heavy tasks across these servers.

This is an orchestration agent, built by Teklia, allowing us to run large Machine Learning processes.

Etymology

According to Wikipedia, Ponos is the personification of hardship or toil.

We chose this tongue-in-cheek name to remind us that this software will be doing a lot of work for us, orchestrating thousands of Docker containers to import images, train Machine Learning models and produce meaningful results.

Availability

This documentation is publicly available, but the software itself is under a proprietary license, and thus its source is not available.

We offer it to our customers using Arkindex Enterprise Edition. Please contact us if you want more information regarding any business opportunity.

Community Edition

A simpler (and limited) version of Ponos Agent is available in Arkindex Community Edition.

It will be useful for hobbyists with a single server and GPU, but not efficient enough for enterprise or institutions with larger compute resources.