NCEAS Product 22942

Bowers, Shawn; McPhillips, Timothy; Ludaescher, Bertram. 2008. Provenance in collection-oriented workflows. Concurrency and Computation-Practice & Experience. Vol: 20(5). Pages 519-529. (Abstract) (Online version)


We describe a provenance model tailored to scientific workflows based on the collection-oriented modeling and design paradigm. Our implementation within the Kepler scientific workflow system captures the dependencies of data and collection creation events on preexisting data and collections, and embeds these provenance records within the data stream. A provenance query engine operates on self-contained workflow traces representing serializations of the output data stream for particular workflow runs. We demonstrate this approach in our response to the first provenance challenge.