Upcoming DM middleware: “Generation 3” Butler and PipelineTask

  • Posted on: 11 May 2018
  • By: swinbank

The development of new data access middleware (the “Generation 3” Data Butler”) and workflow description abstraction (PipelineTask, formerly known as SuperTask) has been making rapid progress for some time. Over the next several months, more and more of this work will filter down to regular pipeline deployments, until ultimately the old middleware can be retired.

In this session, Jim Bosch will give an overview of the key concepts and then DM middleware developers will be available to field questions and walk through examples of the new capabilities and transition plan.

This session is intended to be of interest to DM Science Pipelines developers or others who are regularly writing algorithmic code in the LSST framework.