...

The group has tried to "move up the stack" and define metrics that pertain to general use cases (verticals).  We started to focus on supply chain and looked to define basic performance and scalability measurements for that area. However we got sidetracked with an exploration of working with STAC and shifted focus to some financial areas (my fault on leading us down there). That partnership and work never came to fruition. Now we are back to looking at Provenance and defining some terms and workloads for that area. I will be reaching out to project Grid and the new Supply Chain SIG to see what expertise they can add.

We have had some really good, deep discussions on what we think we should be doing. We see the need to not just define metrics, as we did for our first effort. There is a clear need for benchmarks to get defined and then find places to get them implemented.  STAC has gone silent and SPEC and TPC are not looking in this direction yet.  We will begin to explore working with the Caliper team in the near future.  I think it still desirable to try and leverage other organizations as I don't think that Hyperledger wants to go down the role of maintaining benchmarks, but I think that may be a good discussion for the TSC. ( any decision worth making once is worth making again and again ( my main takeaway from my time at HP ))

...

Additional Information

Reviewed By

•  Arnaud Le Hors
•  Baohua Yang
•  Binh Nguyen
•  Christopher Ferris
•  Dan Middleton
•  Hart Montgomery
•  Kelly Olson
•  Mark Wagner
•  Mic Bowman
•  Nathan George
•  Silas Davis

...