Pachyderm

Pachyderm is an enterprise data science platform. Data teams that find themselves struggling to maintain a growing mess of advanced data science tasks such as machine learning or bioinformatics/genomics use Pachyderm to greatly simplify their workflow and reduce development time. They rely on Pachyderm to do the heavy lifting so they can focus on the business logic in their data pipelines. Data pipelines in Pachyderm are defined by Docker containers which allows data scientists to build production grade pipelines out of any languages and libraries. Pachyderm also tracks the lineage and versioning of your data as it flows through pipelines, giving you deep insight into where data came from and how it's changed over time.